Description

You will lead the migration of Big Data workloads from Cascading/MapReduce to Spark 3 and Kubernetes.

Responsibilities

• Lead the conversion of legacy Cascading and MapReduce code to Spark 3.
• Design and implement the new Kubernetes environment for Big Data workloads.
• Write and review Scala code daily in IntelliJ IDE.
• Execute coding changes and refactoring to support the migration.

Required Skills

• 5+ years of experience in Big Data development.
• Strong proficiency in Scala and Spark 3.
• Experience migrating MapReduce or Cascading applications to Spark.
• Hands-on experience with Kubernetes deployment and management.
• Proficiency with IntelliJ IDE for development and code reviews.
• Deep understanding of Big Data architectures and workload optimization.

Key Skills

Education

Any Graduate