Description

Build and maintain scalable ETL/ELT pipelines on Azure using Databricks and Apache Spark.

This role is on-site.

Responsibilities

• Design, develop, and deploy scalable ETL/ELT pipelines using Databricks, Apache Spark, and PySpark.
• Build and optimize SQL-based data transformation processes, data models, and analytics solutions.
• Develop and maintain Delta Lake architecture and enterprise data pipelines on Azure cloud platforms.
• Implement data quality controls, workflow orchestration, operational monitoring, and production support processes.
• Manage CI/CD processes for Databricks notebooks, jobs, and workflows while improving platform performance.

Required Skills

• 4–6 years of experience in Data Engineering, ETL/ELT development, or cloud-based data platforms.
• Strong hands-on experience with Databricks, Apache Spark, and SQL.
• Proficiency in Python or Scala.
• Experience with ETL/ELT pipeline development in Azure environments.
• Experience in data modeling, performance tuning, and operational monitoring.
• Bachelor’s degree in Computer Science, Information Technology, Data Engineering, Software Engineering, or a related field.

Key Skills

Education

Any Graduate