Description

You will design, build, and maintain scalable ETL/ELT pipelines using Databricks, Apache Spark, and PySpark on Azure.

This role is hybrid.

Responsibilities

• Develop and deploy scalable data pipelines using Databricks, PySpark, and SQL.
• Optimize SQL queries and data transformations for performance and efficiency.
• Implement and manage CI/CD workflows for Databricks jobs and notebooks.
• Ensure data quality, reliability, and monitoring across all pipelines.
• Collaborate with data architects and business teams to deliver data models and insights.

Required Skills

• 10+ years of experience in data engineering.
• 3–5 years of hands-on experience with Databricks and Apache Spark.
• Strong proficiency in PySpark, Scala, and SQL.
• Experience building ETL/ELT pipelines.
• Proven track record with Azure-based data platforms.
• Experience with data modeling and performance tuning.
• Ability to implement CI/CD workflows for data engineering.

Preferred Skills

• Bachelor’s or master’s degree in computer science, Data Engineering, or a related field.

Key Skills

Education

Any Graduate