Description

Key Responsibilities:

Pipeline Design & Development

• Design and build robust, reusable, parameter-driven ingestion and transformation pipelines
• using Azure Data Factory, Synapse Pipelines, Data Bricks and/or Microsoft Fabric Data Factory.
• Implement medallion architecture (Bronze / Silver / Gold) on Azure Data Lake Storage Gen2 using Delta Lake, Parquet, and structured streaming patterns.
• Build performant ELT workflows that leverage pushdown to source systems (Synapse Dedicated SQL Pool, Azure SQL, Teradata) where appropriate.
• Develop and optimize PySpark notebooks and jobs on Azure Databricks or Synapse Spark.

Data Modeling & Warehousin

• gDesign dimensional models (Kimball star/snowflake) and data vault patterns for analytics consumption
• .Implement Slowly Changing Dimensions (Type 1/2/3), Change Data Capture, and late-arriving data patterns
• .Tune distributed SQL workloads in Synapse Dedicated SQL Pool / Fabric Warehouse, including distribution keys, partitioning, and clustered column store indexes

.
Platform Engineering & DevO

• psImplement CI/CD for data pipelines using Azure DevOps (YAML pipelines, ARM/Bicep/Terraform) across Dev / SIT / UAT / Prod environment
• s.Instrument pipelines with robust logging, auditing, and monitoring using Azure Monitor, Log Analytics, and KQ
• L.Enterprise Data Warehouse (EDW) ETL/Informatica Develop
• erDefine and enforce coding standards, code review practices, branching strategies, and release managemen

Key Skills

Education

Any Gradute