Description

You will lead the design and implementation of data processing pipelines using Scala and Spark.

Responsibilities

• Design scalable data processing pipelines for complex workflows.
• Create Scala and Spark jobs to handle data transformation and aggregation.
• Develop unit tests for Spark transformations and helper methods.
• Write Scala doc-style documentation for all codebases.

Required Skills

• 5-7 years of professional experience in data engineering.
• Strong proficiency in Scala.
• Hands-on experience with Spark.
• Solid understanding of Hadoop ecosystems.
• Experience building data transformation and aggregation logic.
• Ability to write clean, documented code following Scala standards.
• Degree in any graduate field.

Key Skills

Education

Any Graduate