Description

You will own the design, construction, and maintenance of scalable data solutions.

Responsibilities

• Build and maintain ETL/ELT data pipelines using Microsoft Fabric and Azure Databricks.
• Migrate and maintain SSIS packages from existing legacy systems.
• Implement medallion architecture (Bronze, Silver, Gold) for data quality and lifecycle management.
• Create and manage notebooks (Fabric Notebooks, Databricks) for data transformation using Python, SQL, and Spark.
• Apply data governance policies utilizing Microsoft Purview or Unity Catalog.

Required Skills

• 5+ years of experience in data engineering or a related field.
• Proficiency in SQL, Python, and Spark.
• Hands-on experience with Microsoft Fabric (Dataflows, Pipelines, Notebooks, OneLake).
• Experience with Power BI for dashboard creation.
• Understanding of ETL/ELT pipelines and data warehousing concepts.
• Familiarity with SSIS migration and maintenance.
• Experience with Azure Databricks and SQL Server/SQL Managed Instances.
• Understanding of LangGraph and RAG DB concepts.

Preferred Skills

• Knowledge of CI/CD automation with Azure DevOps.
• Familiarity with data governance tools like Microsoft Purview or Unity Catalog.

Key Skills

Education

Bachelor's degree