Description

Lead the migration of big data workloads from legacy Cascading and MapReduce systems to Spark 3.

Responsibilities

• Migrate existing Cascading and MapReduce workloads to Spark 3.
• Design and implement new Kubernetes environments for data processing.
• Perform daily Scala code changes and conduct code reviews within IntelliJ IDE.
• Own the technical strategy for workload modernization and containerization.

Required Skills

• 14+ years of software engineering experience.
• Expert-level proficiency in Apache Spark 3.
• Strong hands-on experience with Kubernetes.
• Proven experience converting legacy Cascading and MapReduce workloads.
• Advanced Scala programming skills.
• Proficiency using IntelliJ IDE.
• Bachelor's degree in Computer Science or related field.

Key Skills

Education

Batchelor's