Description

You will design, build, and maintain data integration workflows within the Azure ecosystem.

This role is on-site.

Responsibilities

• Develop and manage ETL pipelines to ingest data from Data Lake to Data Warehouse using Azure Synapse Pipelines, Data Factory, and PolyBase.
• Write and optimize Spark and PySpark code for large-scale data transformation tasks.
• Schedule, monitor, and debug pipelines using Azure Monitor to resolve production issues and failures.
• Write and maintain complex SQL queries and stored procedures for data processing.
• Implement version control and CI/CD processes using Git and Azure DevOps.

Required Skills

• 7+ years of experience in data engineering roles.
• Hands-on experience with Azure Synapse Pipelines and Azure Data Factory.
• Proficiency in Spark and PySpark for large-scale data transformation.
• Strong SQL skills, specifically with complex queries and stored procedures.
• Experience managing Azure cloud services including ADLS, Synapse Analytics, and Azure Monitor.
• Practical knowledge of ETL development and data integration patterns.
• Experience with Git and Azure DevOps for CI/CD processes.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate