Description

You will build and maintain data processing applications using Spark and Scala.

Responsibilities

• Develop and maintain Spark-based data processing applications.
• Design efficient solutions by collaborating with cross-functional teams to define data requirements.
• Implement test-driven deployment practices to ensure application reliability.
• Deploy artifacts across environments and troubleshoot Spark performance issues.
• Support production batches and deliver fixes to meet business needs within an agile environment.

Required Skills

• 5+ years of experience in data development.
• Strong proficiency in Scala programming.
• Extensive experience with Spark application development and optimization.
• Ability to debug and troubleshoot Spark performance bottlenecks.
• Solid understanding of data structures and design patterns for efficient processing.
• Proficiency in SQL and core database concepts.
• Analytical problem-solving skills.
• Bachelor's degree or equivalent graduate education.

Preferred Skills

• Experience with Java, Snowflake, or Databricks.
• Knowledge of Python and DevOps practices.
• Experience with test-driven deployment.

Key Skills

Education

Any Graduate