Description

Develop and maintain distributed data processing workflows and real-time stream processing systems within the Hadoop ecosystem.

This role is on-site.

Responsibilities

• Build and manage real-time and stream processing systems.
• Implement data processing tasks using Java and Python.
• Provide production support for existing data pipelines.
• Maintain distributed systems using the Hadoop ecosystem.

Required Skills

• Hands-on experience with Spark, Hive, and HDFS.
• Proficiency with YARN and Oozie.
• Strong knowledge of Java.
• Experience with Hadoop distributions such as CDH, CDP, or MapR.
• Experience with real-time and stream processing.
• Production support experience.
• Bachelor's degree or equivalent graduate level education.

Preferred Skills

• Experience with Python scripting.
• Knowledge of AWS and Airflow.

Key Skills

Education

ANY GRADUATE