Description

You will design, develop, and maintain scalable batch data pipelines on Azure Databricks.

This role is on-site.

Responsibilities

• Build and maintain scalable batch data pipelines using Apache Spark on Azure Databricks.
• Configure and monitor Databricks Workflows, Jobs, and Pipelines.
• Implement and manage Delta Lake components, including Delta Tables and Delta Live Tables.
• Optimize Spark jobs for performance and cost efficiency.
• Build Spark executable JARs using Maven and manage version control via Git.

Required Skills

• 6+ years of professional experience in data engineering.
• Proficiency in Databricks and PySpark.
• Experience with Apache Spark and Scala.
• Strong SQL skills.
• Working knowledge of Azure services.
• Experience with Git for version control (branching, merging, pull requests).
• Ability to build Spark executable JARs using Maven.

Preferred Skills

• Degree in Computer Science, Engineering, or related field.

Key Skills

Education

Any Gradute