Description

You will lead data engineering initiatives within the Azure ecosystem, owning the design, implementation, and governance of data platforms.

This role is on-site.

Responsibilities

• Design and implement scalable data pipelines using Apache Spark and Delta Lake.
• Operationalize machine learning workflows and manage the ML lifecycle using MLflow.
• Define and enforce cloud governance, security, and compliance standards across the Azure environment.
• Manage infrastructure provisioning and configuration using Infrastructure as Code tools.
• Troubleshoot and debug Azure networking issues to ensure platform stability.

Required Skills

• 5+ years of professional experience in data engineering or related fields.
• Expertise with Apache Spark and Delta Lake for data processing.
• Proficiency with Databricks environments.
• Hands-on experience with MLflow for machine learning lifecycle management.
• Strong knowledge of Azure networking, including troubleshooting and debugging.
• Experience implementing Infrastructure as Code (IaC) using Terraform, CloudFormation, or CDK.

Key Skills

Education

Any Gradute