Description

You will build, maintain, and support high-volume data pipelines and stream processing systems using the Hadoop ecosystem.

This role is on-site.

Responsibilities

• Develop and maintain Hadoop-based data solutions using Spark, Oozie, HDFS, Yarn, and Hive.
• Implement real-time and stream processing architectures to handle high-volume data flows.
• Deploy and manage Hadoop clusters across distributions including CDH, CDP, and MapR.
• Automate workflows and scripting tasks using Python.
• Provide production support, troubleshooting, and maintenance for distributed systems.

Required Skills

• 5+ years of development experience with the Hadoop ecosystem.
• Strong proficiency in Java for core development tasks.
• Hands-on experience with Apache Spark, Oozie, HDFS, Yarn, and Hive.
• Knowledge of multiple Hadoop distributions (CDH, CDP, MapR).
• Experience supporting real-time and stream processing systems.
• Proficiency in Python scripting.

Preferred Skills

• Experience with AWS cloud services.
• Familiarity with Apache Airflow for workflow orchestration.

Key Skills

Education

Any Graduate