Description

You will design and implement data pipelines in Microsoft Fabric to ingest data from SQL Server databases, REST APIs, and enterprise source systems.

This role is on-site.

Responsibilities

• Build and maintain a medallion architecture (Bronze/Silver/Gold) lakehouse following data modeling best practices.
• Develop Python and PySpark notebooks for data transformation, JSON parsing, and complex business logic.
• Implement incremental load strategies using watermarking, change data capture (CDC), and partitioning.
• Diagnose and resolve pipeline reliability issues including authentication failures, token expiration, and performance bottlenecks.

Required Skills

• 5-8 years of experience in data engineering or a related field.
• 2+ years of hands-on experience with Microsoft Fabric.
• 3+ years of Python and PySpark, including notebook-based development.
• 3+ years of experience with data modeling, medallion architecture, star/snowflake schemas, and SCD patterns.
• SQL Server experience: T-SQL, stored procedures, query optimization, and schema design.

Key Skills

Education

Any Graduate