Description

You will manage large-scale data processing tasks using Spark and Databricks.

Responsibilities

• Develop and maintain data pipelines using Spark and Databricks.
• Write and optimize complex SQL queries for data manipulation.
• Build scalable data processing logic using Python.
• Ensure data integrity and performance across distributed systems.

Required Skills

• 5+ years of professional data engineering experience.
• Extensive experience with Apache Spark.
• Proven experience working within Databricks environments.
• Advanced SQL proficiency for data analysis and transformation.
• Strong programming skills in Python.
• Bachelor's degree in Computer Science or a related field.

Key Skills

Education

ANY GRADUATE