Description

Lead the migration of Big Data workloads from Cascading and MapReduce to Spark 3. Design the new Kubernetes environment for Spark workloads.

Responsibilities

• Lead the conversion of legacy Cascading and MapReduce workloads to Spark 3.
• Design the new Kubernetes environment for Spark workloads.
• Perform daily Scala code reviews and implement necessary coding changes for Spark upgrades.
• Develop and maintain code within the IntelliJ IDE.

Required Skills

• 5+ years of software engineering experience.
• Hands-on experience with Spark 3.
• Experience migrating MapReduce workloads.
• Proficiency with Kubernetes.
• Experience working with Scala.
• Experience using IntelliJ IDE.
• Background in Big Data workload migration.

Preferred Skills

• Experience converting Cascading to Spark.

Key Skills

Education

Any Graduate