Description

Key Skills: Azure, Python, Spark, Azure ADF, Databricks, Azure Synapse, SQL, Machine Learning, Power BI

Roles and Responsibilities:

• Design and implement end-to-end data ingestion, transformation, and orchestration pipelines on Azure.
• Develop and optimize Spark jobs in Databricks for batch processing and scalable data transformations.
• Build and maintain SQL-based data models, stored procedures, and performance-tuned queries for analytics workloads.
• Use Azure Data Factory and Azure Synapse to orchestrate workflows, manage dependencies, and support data movement.
• Implement data quality checks, monitoring, and troubleshooting to ensure reliable pipeline execution.

Skills Required:

• 6-10 years of relevant experience in data engineering on Azure
• Azure (data services and cloud data platform experience)
• Databricks and Spark for large-scale data processing
• SQL and Python for data transformation, automation, and performance optimization
• Azure Data Factory and Azure Synapse for orchestration, integration, and analytics-ready data delivery

Good to Have:

• Power BI for building or supporting analytics/reporting datasets
• Machine Learning exposure for integrating ML-ready data pipelines

Education: Bachelor's Degree in Computer Science, Master's Degree in Data Science

Key Skills

Education

Any Graduate