Description

You will build and optimize data pipelines using Databricks, PySpark, Delta Lake, SQL, and Python.

This role is remote.

Responsibilities

• Design and implement ETL/ELT workflows on Databricks.
• Optimize pipeline performance and query efficiency.
• Integrate with Azure data services including ADF, Synapse, and Data Lake.
• Manage CI/CD processes for data infrastructure.
• Maintain robust data architecture using Delta Lake.

Required Skills

• 12+ years of experience in data engineering.
• Hands-on expertise with Databricks and PySpark.
• Strong proficiency in Delta Lake and SQL.
• Advanced Python programming skills.
• Experience with Azure Data Factory (ADF) and Synapse.
• Knowledge of Azure Data Lake Storage.
• Proven track record in performance tuning.

Preferred Skills

• Experience with CI/CD for data pipelines.

Key Skills

Education

Any Graduate