Description

You will manage and maintain large-scale Hadoop environments.

Responsibilities

• Execute weekly server rebuilds (21–30 nodes) ensuring zero data loss and minimal performance impact.
• Perform Hadoop-level pre/post validations, checking cluster health, HDFS usage, replication, skew, and logs.
• Coordinate with Data Center Ops and Unix Admins for hardware and OS-level tasks.
• Reconfigure and reintegrate rebuilt nodes into the cluster.
• Provide weekday and rotational weekend support across BDH1 and BDH4 clusters.

Required Skills

• 9+ years of hands-on experience with the Hadoop ecosystem (HDFS, YARN, MapReduce, HBase).
• Proficiency in log analysis, volume/block checks, and skew troubleshooting.
• Familiarity with open-source Hadoop distributions and production change controls.
• Strong working knowledge of Unix.
• Ability to work independently in a complex environment.

Key Skills

Education

Any Gradute