Description

You will build and maintain data pipelines to support analytics workloads.

Responsibilities

• Build and maintain ETL/ELT pipelines using Azure Databricks and Microsoft Fabric.
• Implement medallion architecture (Bronze, Silver, Gold layers) to support data lifecycle and quality.
• Develop real-time and batch ingestion processes from source systems.
• Design dimensional and real-time data models in collaboration with Domain Owners.
• Support CI/CD pipelines for data workflows using Azure DevOps.

Required Skills

• Bachelor’s degree in computer science, Data Engineering, or related field.
• 5+ years of experience in data engineering or analytics engineering roles.
• Advanced SQL proficiency for data transformation, querying, and optimization.
• Hands-on experience with Azure Databricks (Spark, Delta Lake).
• Expertise in Microsoft Fabric (Dataflows, Pipelines, OneLake).
• Proficiency in SQL and Python (Pandas, PySpark).
• Strong understanding of ETL/ELT processes, data quality, and schema design.
• Familiarity with data modeling, data governance, and data security best practices.
• Experience working with government stakeholders.

Preferred Skills

• Experience with Power BI datasets and semantic modeling.
• Knowledge of Microsoft Purview or similar governance tools.
• Familiarity with Terraform or CI/CD for data pipelines.

Key Skills

Education

Any Graduate