Description

You will lead the migration of Big Data workloads from Cascading and MapReduce to Spark 3 and Kubernetes.

Responsibilities

• Lead the conversion of legacy Cascading and MapReduce workloads to Spark 3.
• Design the new Kubernetes environment for data processing.
• Perform daily Scala code development and code reviews within IntelliJ.
• Implement necessary coding changes to support the Scala and Spark upgrade.

Required Skills

• 5+ years of software engineering experience.
• Expertise in Scala.
• Deep experience with Spark.
• Hands-on experience with Kubernetes.
• Experience migrating workloads from MapReduce or Cascading.
• Proficiency using IntelliJ IDE.
• Bachelor's degree or equivalent experience.

Key Skills

Education

Any Graduate