Description

You will design and maintain scalable ETL/ELT data pipelines to support a modern data platform migration.

Responsibilities

• Build and maintain scalable ETL/ELT pipelines using Microsoft Fabric and Azure Databricks.
• Implement medallion architecture (Bronze, Silver, Gold) to manage data lifecycle and quality.
• Create and manage notebooks in Fabric and Databricks using Python, SQL, and Spark.
• Develop dimensional and real-time data models to support Power BI dashboards.
• Support the decommissioning of legacy SQL-based infrastructure and SSRS.
• Apply data governance policies including row-level security and data masking via Microsoft Purview or Unity Catalog.
• Automate data workflows using CI/CD through Azure DevOps.

Required Skills

• 5+ years of experience in data engineering, preferably in government or regulated environments.
• Hands-on experience with Microsoft Fabric (Dataflows, Pipelines, Notebooks, OneLake).
• Proficiency in SQL, Python, and Spark.
• 5+ years of experience with Power BI data modeling and dashboard development.
• 5+ years of experience with ETL/ELT pipelines, data warehousing, and schema design.
• 5+ years of experience with data governance tools such as Microsoft Purview or Unity Catalog.
• Bachelor’s degree in Computer Science, Information Systems, or a related field.
• Experience with SQL Server and SQL Managed Instances.

Preferred Skills

• Azure DevOps CI/CD automation knowledge.
• Microsoft Certified: Fabric Analytics Engineer or Azure Data Engineer Associate.
• Familiarity with data security and compliance frameworks like FIPS 199 or NIST.

Key Skills

Education

Bachelor's degree