Description

You will design, develop, and deploy scalable ETL/ELT data pipelines using Apache Spark, PySpark, and Databricks. This role is on-site.

Responsibilities

• Develop and optimize SQL queries for data transformation and analysis.
• Collaborate with product owners, data architects, and analysts to build data models, Delta Lake structures, and data workflows.
• Build job orchestration and monitoring solutions to ensure data quality, performance, and reliability.
• Develop and maintain CI/CD pipelines for Databricks notebooks, jobs, and workflows.
• Work with cloud-based data platforms, preferably Azure.

Required Skills

• 10+ years overall experience in data engineering or related fields.
• 3–5 years hands-on experience with Databricks and Spark.
• Strong proficiency in SQL and data analysis techniques.
• Experience with ETL processes, data modeling, and performance tuning.
• Familiarity with Python or Scala for data engineering tasks.
• Bachelor's degree in a relevant field.

Key Skills

Education

Bachelor's degree