Description
You will design and maintain medallion lakehouse architectures and enterprise data pipelines using Azure Databricks, Snowflake, and Microsoft Fabric.
This role is hybrid.
Responsibilities
- Implement Bronze, Silver, and Gold layer patterns for data ingestion, cleaning, standardization, and curation.
- Build reliable data pipelines using Azure Databricks, SQL, and Python for structured and semi-structured data.
- Design and support orchestration workflows using Azure Data Factory and implement data quality checks and monitoring.
- Enable semantic layers and models through Microsoft Fabric, including Lakehouse, Warehouse, and Power BI integration.
- Optimize pipelines for performance and scalability while collaborating with analysts and stakeholders to deliver trusted data products.
Required Skills
- 3-5 years of experience in data engineering or analytics engineering.
- Strong hands-on experience with SQL and Python for data transformation and validation.
- Experience building ingestion pipelines into a lakehouse or enterprise data warehouse.
- Hands-on experience with Azure Databricks and distributed data processing.
- Experience with Snowflake, including data loading, transformation, and performance tuning.
- Working knowledge of enterprise data warehouse design, dimensional modeling, star schemas, and fact/dimension tables.
- Understanding of data governance, metadata management, lineage, and production support best practices.
Preferred Skills
- Experience with Microsoft Fabric, including Fabric Lakehouse, OneLake, and semantic model integration.
- Certifications in Azure, Microsoft Fabric, Databricks, or Snowflake.
- Experience with Delta Lake, Unity Catalog, or similar lakehouse governance technologies.