Description

You will build and maintain scalable ETL/ELT pipelines using Microsoft Fabric and Azure Databricks.

This role is hybrid.

Responsibilities

• Implement Medallion Architecture (Bronze, Silver, Gold) for data lakehouse structures.
• Migrate and maintain existing SSIS packages to modern cloud-native solutions.
• Develop Python and Spark notebooks for complex data transformations.
• Support Power BI reporting datasets and ensure data quality for business analytics.
• Collaborate with business and analytics teams to define data requirements.

Required Skills

• 5+ years of experience as a Data Engineer.
• Strong expertise in Microsoft Fabric (Dataflows, Pipelines, Notebooks, OneLake).
• Proficiency in Azure Databricks, SQL Server, and SQL Managed Instances.
• Hands-on experience with Python, SQL, and Spark.
• Experience building ETL/ELT pipelines and data integration workflows.
• Familiarity with Azure DevOps for CI/CD processes.
• Knowledge of Power BI for data visualization and reporting.

Preferred Skills

• Experience with LangGraph and RAG architectures.
• Knowledge of Microsoft Purview or Unity Catalog for governance.

Key Skills

Education

Any Graduate