Description

You will design, build, and maintain scalable data pipelines and cloud-based analytics solutions on the Microsoft Azure platform.

This role is hybrid.

Responsibilities

• Design and develop scalable ETL pipelines and data workflows using ADF and Databricks.
• Build and maintain data storage solutions on Azure Data Lake and Synapse.
• Optimize data ingestion, transformation, and loading processes for performance.
• Implement data validation, monitoring, and logging frameworks to ensure reliability.
• Manage version control and deployment using Azure DevOps CI/CD pipelines.

Required Skills

• 4-8 years of total experience in data engineering.
• 2+ years of hands-on experience with the Azure ecosystem.
• Proficiency in Azure Data Factory (ADF), Azure Data Lake, and Synapse Analytics.
• Strong programming skills in SQL, Python, and PySpark.
• Experience with Databricks for data processing and transformation.
• Knowledge of ETL development, data modeling, and Azure Storage.
• Familiarity with CI/CD practices using Azure DevOps.

Preferred Skills

• Basic understanding of Power BI for dashboard integration and automation.
• Experience with data governance and security compliance within Azure.

Key Skills

Education

Any Graduate