Description

You will design and implement large-scale data processing systems using Java and the Hadoop ecosystem.

This role is remote.

Responsibilities

• Develop and maintain high-performance data pipelines using Java, Spark, and Hadoop.
• Implement real-time streaming solutions with Apache Storm or Flink.
• Manage distributed data storage and querying via HBase, Hive, and HDFS.
• Orchestrate complex workflows using Oozie and Pig.
• Ensure system reliability, high availability, and scalability across distributed environments.

Required Skills

• 5+ years of hands-on Java development experience.
• 8+ years total experience in data engineering or big data systems.
• Strong proficiency with the Hadoop ecosystem: Oozie, Pig, Hive, Spark, HBase.
• Experience with real-time/streaming technologies such as Apache Storm or Flink.
• Hands-on experience with Kafka or similar message queuing systems.
• Solid understanding of HDFS, MapReduce, and distributed systems architecture.
• Ability to design for high availability and fault tolerance.

Key Skills

Education

Any Graduate