Description

You will build and maintain scalable data processing pipelines using Apache Spark.

Responsibilities

• Develop and maintain data processing applications using Scala, Java, or Python.
• Manage big data workflows utilizing Hadoop, Hive, Kafka, and HDFS.
• Write and optimize complex SQL queries for relational databases.
• Implement data solutions across AWS, Azure, or Google Cloud.
• Collaborate with team members to solve technical problems and ensure data accuracy.

Required Skills

• 5+ years of experience with Apache Spark.
• Proficiency in Scala, Java, or Python.
• Hands-on experience with Hadoop, Hive, and Kafka.
• Strong SQL skills and experience with relational databases.
• Experience working with AWS, Azure, or Google Cloud.
• Knowledge of HDFS.
• Experience with Docker and Kubernetes.
• Master's degree in Computer Science or a related field.

Key Skills

Education

Master's degree