Description

You will design and maintain data architectures using Microsoft Fabric and Apache Spark to support enterprise analytics.

This role is hybrid.

Responsibilities

• Build ETL/ELT pipelines using Microsoft Fabric Pipelines and Notebooks.
• Develop and optimize PySpark and Spark SQL jobs for large-scale data processing.
• Implement Delta Lake tables and manage OneLake storage solutions.
• Integrate streaming data and APIs into the data platform.
• Enable Power BI reporting by structuring data models and ensuring data quality.

Required Skills

• 7+ years of experience in database development or data engineering.
• Strong proficiency in Microsoft Fabric components (Lakehouse, OneLake, Pipelines).
• Expertise in Apache Spark, specifically PySpark and Spark SQL.
• Advanced SQL and Python programming skills.
• Hands-on experience with Delta Lake and Delta Tables.
• Proven track record in ETL/ELT pipeline development.
• Experience with API and streaming data integration.
• Familiarity with Power BI data enablement and modeling.

Preferred Skills

• Bachelor's degree in Computer Science or related field.
• 5+ years of tenure in previous similar roles.

Key Skills

Education

Bachelor's degree