Description

You will design, develop, and optimize data processing applications using Spark and Scala.

Responsibilities

• Develop and maintain data processing applications using Spark and Scala.
• Collaborate with cross-functional teams to design efficient solutions based on data requirements.
• Implement test-driven deployment practices to improve application reliability.
• Deploy artifacts across environments to ensure smooth transitions.
• Troubleshoot and debug Spark performance issues to ensure optimal processing.

Required Skills

• 5+ years of experience in data processing roles.
• Strong proficiency in Scala programming.
• Deep knowledge of Spark, including application development and optimization.
• Ability to troubleshoot and debug Spark performance bottlenecks.
• Solid understanding of design patterns and data structures for efficient processing.
• Familiarity with SQL and core database concepts.
• Bachelor's degree.

Preferred Skills

• Experience with Java, Python, or Snowflake.
• Knowledge of Databricks and DevOps practices.
• Experience with test-driven deployment.

Key Skills

Education

Bachelor's degree