Description

You will design, develop, and maintain end-to-end data pipelines on Azure.

Responsibilities

• Design and develop data pipelines using Azure Data Factory, Databricks, and Synapse Analytics.
• Implement ETL/ELT processes to integrate data from structured and unstructured sources.
• Build and optimize data lake and data warehouse solutions in ADLS and Azure Synapse.
• Develop CI/CD pipelines for data workflows using Azure DevOps or equivalent tools.
• Monitor, troubleshoot, and optimize data solutions for performance and cost efficiency.

Required Skills

• 7+ years of experience in a data engineering role.
• Proficiency in Azure Data Factory (ADF) and Azure Databricks.
• Strong command of SQL, Python, PySpark, or Scala.
• Experience with Azure Synapse Analytics and Azure Data Lake Storage (ADLS Gen2).
• Familiarity with Git and CI/CD pipelines using Azure DevOps or GitHub Actions.
• Knowledge of Spark and Delta Lake for big data processing.
• Understanding of dimensional modeling, star schema, and snowflake schema.
• Experience with ETL/ELT design and API integration.

Key Skills

Education

Any Graduate