Description

You will design, build, and optimize scalable data pipelines and analytics platforms on Azure.

This role is remote.

Responsibilities

• Design and build reusable ingestion and transformation pipelines using Azure Data Factory, Synapse Pipelines, Databricks, and Microsoft Fabric.
• Implement medallion architecture on Azure Data Lake Storage Gen2 using Delta Lake, Parquet, and structured streaming.
• Develop and optimize PySpark notebooks and jobs on Azure Databricks or Synapse Spark for performant ELT workflows.
• Design dimensional models (Kimball) and data vault patterns, including Slowly Changing Dimensions and Change Data Capture.
• Implement CI/CD for data pipelines using Azure DevOps and instrument them with Azure Monitor and Log Analytics.

Required Skills

• 5+ years of experience in data engineering.
• Strong proficiency in PySpark and ETL/ELT design.
• Hands-on experience with Azure Data Factory and Synapse Pipelines.
• Experience with Databricks and Microsoft Fabric.
• Knowledge of Azure Data Lake Storage Gen2 and Delta Lake.
• Understanding of data modeling (star/snowflake schemas, data vault).
• Familiarity with Azure DevOps for CI/CD implementation.

Preferred Skills

• Experience with Synapse Dedicated SQL Pool performance tuning (distribution keys, partitioning).
• Knowledge of Teradata or Azure SQL pushdown optimization.

Key Skills

Education

Any Gradute