Description

Hello,

We are looking for a Senior Databricks Data Engineer to build scalable data pipelines and enterprise-grade Lakehouse solutions using Azure Databricks. The role involves working on Finance data migration from SAP systems to a modern cloud data platform.

Key Responsibilities

Design and develop scalable ETL/ELT data pipelines.

Develop transformations using PySpark and Spark SQL. Build Bronze, Silver & Gold data layers.

Work with Delta Lake, ADF and ADLS Gen2. Integrate SAP and enterprise source systems.

Develop incremental and CDC pipelines. Optimize Spark jobs for performance and cost.

Implement data quality and validation frameworks. Support CI/CD, deployments and production troubleshooting.

Required Skills

8–12 years of Data Engineering experience. Strong hands-on Azure Databricks experience.

Expert in PySpark, Spark SQL and SQL. Strong experience with Delta Lake.

Experience with Azure Data Factory & ADLS Gen2.

Good understanding of Git and CI/CD.

Knowledge of SAP data extraction/integration.

📍 Location: Mumbai, India | Work Mode: WFO
💼 Experience: 8–10 Years
 

Thanks & Regards

Register for global opportunity on world's 1st & only Global Technology Job Portal  www.iitjobs.com 

Refer and earn Rs.50,000/-

You can download our IIT Jobs app for free from Google Store

Key Skills

Education

Any Graduate