Description

You will lead the migration of Big Data workloads to Kubernetes and Spark 3.

This role is hybrid.

Responsibilities

• Lead the conversion of existing Cascading/MapReduce workloads to Spark 3.
• Design and implement the new Kubernetes environment.
• Develop and modify Scala code to facilitate the Spark upgrade.
• Review Scala code and make necessary coding changes within the IntelliJ IDE.

Required Skills

• 10+ years of professional experience.
• Expert proficiency with Spark, specifically Cascading or MapReduce.
• Strong experience with Kubernetes.
• Proficiency in Scala.
• Experience migrating MapReduce jobs to Spark.
• Daily coding and development work in IntelliJ IDE.

Preferred Skills

• Any Graduate.

Key Skills

Education

Any Graduate