Description

You will design, build, and maintain scalable data solutions using Microsoft Fabric and Azure Databricks.

This role is hybrid.

Responsibilities

• Build and maintain ETL/ELT data pipelines using Microsoft Fabric and Azure Databricks.
• Migrate and maintain SSIS packages from legacy systems.
• Implement medallion architecture (Bronze, Silver, Gold) for data quality and lifecycle management.
• Create and manage notebooks for data transformation using Python, SQL, and Spark.
• Apply data governance policies utilizing Microsoft Purview or Unity Catalog.

Required Skills

• 5+ years of experience in data engineering or a related field.
• Proficiency in SQL, Python, and Spark.
• Hands-on experience with Microsoft Fabric (Dataflows, Pipelines, Notebooks, OneLake).
• Experience with Azure Databricks and SQL Server/SQL Managed Instances.
• Experience with Power BI for dashboard creation.
• Understanding of ETL/ELT pipelines and data warehousing concepts.
• Familiarity with SSIS migration and maintenance.
• Understanding of LangGraph and RAG DB concepts.

Preferred Skills

• Knowledge of CI/CD automation with Azure DevOps.
• Familiarity with data governance tools like Microsoft Purview or Unity Catalog.

Key Skills

Education

Bachelor's degree