Description

You will design and lead scalable data integration solutions for an enterprise Azure and Databricks Lakehouse.

This role is hybrid.

Responsibilities

• Design and implement ETL/ELT architecture using Databricks for the enterprise Lakehouse.
• Integrate data from diverse sources including RDBMS, APIs, SaaS apps, flat files, and streaming platforms.
• Define data integration best practices covering reusability, scalability, and cost optimization.
• Lead and mentor ETL/ELT developers in building data pipelines.
• Establish data quality, governance, and lineage frameworks across heterogeneous systems.

Required Skills

• 10+ years of experience in ETL/ELT architecture and development.
• Strong expertise in Databricks components: warehouses, streams, tasks, notebooks, and data sharing.
• Proficient in SQL and performance optimization.
• Experience integrating data from Oracle, SQL Server, SAP, Salesforce, and REST APIs.
• Hands-on experience with cloud platforms (AWS, Azure, GCP) for data integration.
• Solid understanding of data modeling (star schema, snowflake schema, data vault) and data warehousing principles.
• Experience working with flat files and cloud-native systems.
• Strong leadership and communication skills for onsite stakeholder management.

Preferred Skills

• Experience with Kafka for streaming data integration.

Key Skills

Education

Any Graduate