Description

Develop and maintain data processing workflows and distributed systems within the Hadoop ecosystem. Build real-time stream processing systems and provide production support for existing data pipelines.

Responsibilities

• Develop and maintain distributed systems using the Hadoop ecosystem.
• Build and manage real-time and stream processing systems.
• Provide production support for existing data pipelines.
• Implement data processing tasks using Java and Python scripting.

Required Skills

• Hands-on experience with Spark, Hive, and HDFS.
• Proficiency with YARN and Oozie.
• Strong knowledge of Java.
• Experience with Hadoop distribution systems such as CDH, CDP, or MapR.
• Experience working with real-time and stream processing.
• Production support experience.
• Bachelor's degree or equivalent graduate level education.

Preferred Skills

• Experience with Python scripting.
• Knowledge of AWS and Airflow.

Key Skills

Education

ANY GRADUATE