Description

You will design, build, and maintain scalable lakehouse architectures in Microsoft Fabric and OneLake, ensuring high availability and performance.

This role is hybrid.

Responsibilities

• Build and maintain end-to-end data pipelines for ingestion, transformation, and serving across batch and real-time sources.
• Develop scalable ingestion frameworks for APIs, databases, event streams, and enterprise systems (Jira, ERP, CRM).
• Execute large-scale Spark jobs and author notebooks in PySpark and SQL for data cleansing, enrichment, and transformation.
• Implement data validation, quality controls, and logic for structured, semi-structured, and unstructured data.
• Deliver analytics-ready datasets for Power BI and downstream consumption.

Required Skills

• 7+ years of experience with Microsoft Fabric (Lakehouse, OneLake, Pipelines, Notebooks).
• Strong proficiency in Apache Spark (PySpark, Spark SQL) and Python.
• Extensive experience with SQL and ETL/ELT pipeline design.
• Hands-on experience with Delta Lake and Delta Tables.
• Proven ability to integrate API and streaming data sources.
• Bachelor's degree in a relevant field.
• Experience integrating enterprise systems such as Jira, ERP, and CRM.

Key Skills

Education

Bachelor's degree