Description

Design and maintain large-scale Azure Databricks environments. Automate MLOps workflows and manage cloud infrastructure.

Responsibilities

• Design, develop, and implement large Databricks environments in collaboration with stakeholder teams.
• Facilitate Machine Learning models using Spark, PySpark, and PyTorch within distributed computing ecosystems.
• Develop Infrastructure as Code (IaC) to automate environment deployments and ensure reproducibility.
• Create and maintain a library of scripts to automate Databricks MLOps environments.
• Perform production deployments and model monitoring to ensure stable system performance.

Required Skills

• 5+ years of experience developing and implementing models in cloud ecosystems such as Azure, AWS, or GCP.
• Hands-on experience with Databricks, Spark, and SageMaker or similar distributed computing technologies.
• Proficiency in configuring Machine Learning platforms to meet specific product requirements.
• Ability to develop Infrastructure as Code (IaC) for automation.
• Manage Databricks environments according to security guidelines.
• Bachelor's degree.
• Strong written and verbal communication skills.

Preferred Skills

• Understanding of Azure resources including containers, virtual machines, storage, log analytics, alerting, metrics, Azure AD, Key Vaults, and Azure Backup.

Key Skills

Education

Bachelor's degree