Description

You will design, develop, and optimize data processing applications using Spark and Scala.

Responsibilities

• Develop and maintain data processing applications using Spark and Scala.
• Collaborate with cross-functional teams to design efficient solutions based on data requirements.
• Implement test-driven deployment practices to improve application reliability.
• Deploy artifacts across environments and troubleshoot Spark performance issues.
• Support production batches by addressing issues and providing fixes.

Required Skills

• 5+ years of experience in data development.
• Strong proficiency in Scala programming.
• Hands-on experience with Spark application development and optimization.
• Ability to troubleshoot and debug Spark performance issues.
• Solid understanding of design patterns and data structures.
• Proficiency in SQL and database concepts.
• Experience working in agile environments.

Preferred Skills

• Experience with Java, Snowflake, or Databricks.
• Familiarity with Python, Akka, Apache Kafka, or DevOps practices.

Key Skills

Education

ANY GRADUATE