Description

Design and build scalable data ingestion frameworks and ETL/ELT pipelines using Microsoft Fabric and Azure Data Services. You will architect medallion lakehouse solutions and optimize big data processing with Python and Spark.

This role is remote.

Responsibilities

• Architect and implement end-to-end data ingestion frameworks on Microsoft Fabric.
• Develop high-performance ETL/ELT pipelines using Python, SQL, and Spark.
• Design medallion architecture patterns for structured data lakehouses.
• Optimize data processing workflows within the Azure ecosystem.
• Maintain and scale existing Azure Data Services integrations.

Required Skills

• 12-15+ years of overall software engineering experience.
• H1B visa status required.
• Strong expertise in Python, SQL, and Spark (minimum 5 years).
• Hands-on experience with Azure Data Services and Microsoft Fabric.
• Proven track record building ETL/ELT pipelines.
• Deep understanding of medallion architecture concepts.

Preferred Skills

• Experience with complex data ingestion frameworks.
• Advanced SQL optimization skills.

Key Skills

Education

Not specified