Description

You will design and maintain large-scale data processing systems using Java and the Hadoop ecosystem.

This role is remote.

Responsibilities

• Develop and optimize batch processing pipelines using Hadoop, Hive, Pig, and Oozie.
• Build and manage real-time streaming architectures with Apache Flink, Apache Storm, and Kafka.
• Ensure high availability and performance of distributed systems including HDFS and MapReduce.
• Collaborate on integrating HBase for NoSQL storage requirements.

Required Skills

• 8+ years of professional software engineering experience.
• Strong hands-on experience in Java development.
• 5+ years with the Hadoop ecosystem (Oozie, Pig, Hive, Spark, HBase).
• Experience with real-time streaming technologies (Apache Storm, Flink).
• Hands-on experience with Kafka or similar queuing systems.
• Solid understanding of HDFS, MapReduce, and distributed systems principles.
• Knowledge of high availability configurations in distributed environments.

Key Skills

Education

Any Graduate