Description

The Role

You will play a key role in designing and delivering a scalable, metadata-driven ingestion and transformation framework within Microsoft Fabric. The role focuses on building and optimising Bronze, Silver, and Gold Lakehouse layers to support semantic modelling and analytics outcomes.

Duties / Typical Day / Responsibilities

• Design and build metadata-driven ingestion pipelines from SQL Server into Microsoft Fabric using dynamic Fabric pipelines
• Build and manage Bronze, Silver, and Gold Lakehouse layers
• Develop Bronze-to-Silver transformation pipelines using SQL or Dataflows Gen2
• Create and maintain Gold tables for semantic modelling
• Build Silver-to-Gold pipelines using SQL or Dataflows Gen2
• Optimise Delta Lake and OneLake performance
• Implement data security (RBAC) and workspace segregation
• Maintain and manage code using Azure DevOps
• Support deployment through Git and Fabric deployment pipelines

Skills

• Strong experience in data engineering framework development
• Advanced skills in Microsoft Fabric, Azure, Databricks, SQL, Fabric Lakehouse, and Python
• Deep understanding of Data Lakehouse and medallion architecture
• Experience building metadata-driven ELT pipelines
• Strong knowledge of Delta Lake optimisation and OneLake
• Experience with data RBAC and environment/workspace segregation
• Proficiency with Git and CI/CD deployment pipelines

Key Skills

Education

Any Graduate