Description

Design and optimize data processing applications using Spark and Scala.

Responsibilities

• Develop and maintain data processing applications using Spark and Scala.
• Collaborate with cross-functional teams to design efficient solutions based on data requirements.
• Implement test-driven deployment practices to improve application reliability.
• Deploy artifacts across environments and troubleshoot Spark performance issues.
• Support production batches by debugging and providing fixes for critical business needs.

Required Skills

• 5+ years of experience in software development.
• Strong proficiency in Scala programming.
• Hands-on experience with Spark application development and optimization.
• Ability to troubleshoot and debug Spark performance bottlenecks.
• Solid understanding of design patterns and data structures for efficient processing.
• Proficiency in SQL and database concepts.
• Experience working within agile environments.
• Any graduate degree.

Preferred Skills

• Familiarity with Python, Databricks, and DevOps practices.
• Experience with Akka, Apache Kafka, and test-driven deployment.

Key Skills

Education

ANY GRADUATE