Description

• Design, develop, and maintain scalable data ingestion, processing, and transformation pipelines.
• Build and optimize ETL/ELT workflows using Azure Data Factory, Microsoft Fabric, and dbt.
• Work extensively with Azure Data Lake Storage Gen2, Microsoft Fabric Lakehouses, and Warehouses.
• Implement Medallion Architecture across Bronze, Silver, and Gold data layers.
• Develop efficient data models, schemas, and transformation processes.
• Write advanced SQL and Python for data processing, transformation, and automation.
• Perform query and pipeline performance tuning.
• Implement data quality, validation, and pipeline testing frameworks.
• Work with Snowflake and other cloud data platforms.
• Support reporting and analytics use cases using tools such as Looker.
• Implement version control using Git and follow CI/CD fundamentals.
• Contribute to metadata management, data cataloging, governance, and security.
• Collaborate with cross-functional teams to deliver reliable and high-quality data solutions.
• Explore and leverage AI/ML platforms where applicable.

Requirements / Qualifications:

• 5+ years of professional experience in Data Engineering.
• Strong hands-on experience with:
  • Azure Data Factory (ADF) – Mandatory
  • Azure Data Lake Storage Gen2 (ADLS Gen2) – Mandatory
  • Microsoft Fabric Lakehouse & Warehouse – Mandatory
• Experience with Snowflake and modern cloud data platforms.
• Strong knowledge of ETL/ELT pipeline development and data transformation.
• Proficiency in Python and Advanced SQL.
• Strong understanding of data modeling and schema design.
• Experience with dbt.
• Knowledge of Data Lakehouse and Medallion Architecture.
• Experience implementing data quality and validation frameworks.
• Familiarity with Git and CI/CD fundamentals.
• Understanding of data governance, metadata management, data cataloging, and security.
• Experience with Looker or similar BI/reporting tools is preferred.
• Exposure to Azure and GCP cloud environments is an advantage.
• Experience with AI/ML platforms is desirable

Key Skills

Education

Bachelor's degree