Description

Design, develop, and support large-scale distributed data processing applications using Apache Spark and Scala.

This role is hybrid.

Responsibilities

• Build and optimize data pipelines using Spark Core, Spark SQL, and Spark Streaming.
• Develop scalable solutions for processing large volumes of data and maintain clean, efficient Scala code.
• Design and develop ETL and data warehousing solutions using Python, Hadoop, Hive, and HDFS.
• Perform SQL and NoSQL database development, optimization, and troubleshooting.
• Collaborate with cross-functional teams in Agile ceremonies and support production environments.

Required Skills

• 8+ years of experience with Apache Spark (Core, SQL, Streaming) and Scala.
• Strong programming experience in Python and SQL.
• Experience with Hadoop ecosystem technologies including Hive and HDFS.
• Good understanding of Data Structures and Algorithms.
• Knowledge of ETL and Data Warehousing concepts.
• Bachelor's degree in a relevant field.
• Experience working in Agile environments.

Preferred Skills

• Experience with NoSQL database development and optimization.
• Strong analytical, troubleshooting, and problem-solving skills.

Key Skills

Education

Bachelor's degree