Description

You will build and manage data pipelines processing millions of records.

This role is on-site.

Responsibilities

• Process and manage large-scale datasets containing millions of records.
• Develop data processing logic using Scala and Python.
• Implement Spark applications within the Databricks platform.
• Maintain data workflows using PySpark.

Required Skills

• 3+ years of experience in data engineering.
• Proficiency with Scala.
• Proficiency with Python.
• Experience with PySpark.
• Hands-on experience using Spark on the Databricks platform.
• Proven track record of handling datasets with millions of records.
• Bachelor's degree or equivalent graduate qualification.

Key Skills

Education

Any Graduate