Description

You will build and maintain scalable data pipelines using distributed computing frameworks.

Responsibilities

• Develop and optimize data processing workflows using PySpark and Databricks.
• Design and manage orchestration tasks within Airflow.
• Write and tune complex SQL queries for data transformation and analysis.
• Apply data structures and algorithms to solve complex engineering problems.
• Collaborate with team members to deliver scalable data solutions.

Required Skills

• 5 to 8 years of experience in data engineering roles.
• Proficiency in Python.
• Advanced SQL skills.
• Hands-on experience with PySpark.
• Experience working with Databricks.
• Experience with Airflow.
• Strong understanding of data structures and algorithms.

Education

• Any graduate degree.

Key Skills

Education

Any graduate