Description

You will design, develop, and maintain scalable ELT pipelines using Databricks, Delta Live Tables, PySpark, SQL, and Python across Bronze/Silver/Gold lakehouse layers.

This role is on-site.

Responsibilities

• Build and optimize Delta Live Tables (DLT) pipelines with data quality expectations, lineage visibility, and auto-healing behavior.
• Ingest and integrate data from sources including databases and connectors into the lakehouse, ensuring consistent transformations and reusable shared code packages.
• Implement data quality frameworks including schema checks, freshness/accuracy SLAs, and completeness monitoring.
• Operate and monitor end-to-end pipelines, track job execution and SLA adherence, and perform RCA for pipeline incidents.
• Support change requests and controlled releases across environments.

Required Skills

• 3+ years of hands-on data engineering experience.
• ETL development experience with ELT patterns on Databricks lakehouse workflows.
• Hands-on PySpark and Databricks development (jobs, notebooks, DLT pipelines, Delta Lake).
• Azure Databricks experience and ability to work within Azure cloud environments.
• Strong SQL and Python coding skills for transformations, data quality checks, and pipeline logic.

Preferred Skills

• MySQL and additional database integration experience.

Key Skills

Education

Any Graduate