Description

Lead data engineering efforts within the Azure ecosystem, focusing on scalable ETL processes and data warehousing.

This role is on-site.

Responsibilities

• Build and maintain data pipelines using Azure Data Factory and Databricks.
• Manage structured and unstructured data at scale using Delta Lake and ADLS.
• Optimize data processing performance through PySpark and Spark-based tuning.
• Implement CI/CD workflows for data engineering using Azure DevOps or GitHub Actions.
• Apply data modeling, governance, and security practices across the Azure environment.

Required Skills

• 10+ years of experience in data engineering.
• 2+ years in a leadership or senior developer role.
• Expertise in Azure Data Factory (ADF), Azure Databricks (ADB), and Azure Synapse.
• Proficiency in Python, PySpark, and SQL.
• Hands-on experience with Azure Data Lake Storage (ADLS) and Azure Functions.
• Deep understanding of Delta Lake and ETL/DWH patterns.
• Experience with CI/CD tools like Azure DevOps or GitHub Actions.
• Strong knowledge of data modeling and security practices on Azure.

Key Skills

Education

Any Graduate