Description

You will lead technical initiatives focused on data engineering within the Azure ecosystem.

Responsibilities

• Design and implement data pipelines using Apache Spark and Delta Lake.
• Manage and operationalize machine learning workflows using MLflow.
• Define and enforce cloud governance, security, and compliance standards.
• Manage infrastructure provisioning using Terraform, CloudFormation, or CDK.

Required Skills

• 5+ years of professional experience in data engineering or related fields.
• Expertise with Apache Spark and Delta Lake.
• Proficiency with Databricks environments.
• Hands-on experience with MLflow for ML lifecycle management.
• Strong knowledge of Azure networking, including troubleshooting and debugging.
• Experience implementing Infrastructure as Code (IaC) using Terraform or CloudFormation/CDK.

Key Skills

Education

Any Gradute