Description

You will own the development and maintenance of data processing pipelines using Scala and Spark.

Responsibilities

• Build and maintain scalable data processing pipelines for transformation and aggregation.
• Create and execute Spark jobs using Scala.
• Write unit tests for Spark transformations and helper methods.
• Produce Scala doc-style documentation for all code.

Required Skills

• 3+ years of hands-on coding experience with Scala.
• Strong experience writing and executing Spark jobs.
• Proficiency in SQL.
• Experience working within Hadoop ecosystems.
• Ability to implement unit testing for data transformations.

Key Skills

Education

Not specified