Spark and Scala Developer

You will build and support scalable Big Data applications and modern data pipelines in a software product environment.

Responsibilities

• Build and support scalable Big Data applications within a software product development lifecycle.
• Develop modern, scalable data pipelines to ensure prompt data delivery.
• Collaborate with team members to deliver production-ready data solutions.
• Maintain and optimize data processing workflows using Hadoop technologies.

Required Skills

• 7 to 10 years of overall software development experience.
• 4+ years of experience building and supporting scalable Big Data applications.
• Deep technical knowledge of the Spark Engine.
• Proficiency in Spark and Scala.
• Experience with Hadoop technologies including YARN and HDFS.
• Hands-on experience with Hive and Oozie.
• Experience managing workflows with Airflow.
• Proficiency in Shell scripting.
• Bachelor's degree in any field.