Description

You will design, build, and maintain scalable lakehouse architecture and data pipelines within a Microsoft Fabric environment to support analytics and reporting needs.

This role is on-site.

Responsibilities

• Develop scalable frameworks for batch and real-time data ingestion from APIs, databases, and streaming platforms.
• Create and manage end-to-end data pipelines for ingestion, transformation, and serving of data.
• Implement data cleansing, enrichment, and transformation logic using Spark jobs and notebooks.
• Design and maintain scalable lakehouse architecture using Microsoft Fabric and OneLake.
• Deliver data scripts and tools to support analytics and reporting requirements.

Required Skills

• 5+ years of experience in data development.
• Proficiency with Microsoft Fabric components: Lakehouse, OneLake, Pipelines, and Notebooks.
• Strong knowledge of SQL and Python programming languages.
• Experience with Apache Spark, PySpark, and Spark SQL for large-scale data processing.
• Understanding of Delta Lake and Delta Tables for data management.
• Experience designing and implementing data pipelines (ETL/ELT).
• Experience integrating API and streaming data sources.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate