Description

Design, develop, and deploy scalable ETL/ELT data pipelines using Apache Spark, PySpark, and Databricks.

Develop and optimize SQL queries for data transformation and analysis.

Collaborate with product owners, data architects and analysts to build data models, delta lake structures, and data workflows.

Collaborate with data analysts and business teams to deliver actionable insights.

Build job orchestration and monitoring solutions Ensure data quality, performance, and reliability across workflows.

Develop and maintain CI/CD pipelines for Databricks notebooks, jobs, and workflows.

Work with cloud-based data platforms (Azure preferred).

Required Skills & Experience:

10+ years overall experience in data engineering or related fields.

3–5 years hands-on experience with Databricks and Spark.

Strong proficiency in SQL and data analysis techniques.

Experience with ETL processes, data modeling, and performance tuning.

Familiarity with Python or Scala for data engineering tasks.

Excellent problem-solving and communication skills

Key Skills

Education

Bachelor's degree