Description

You will manage and maintain Hadoop cluster infrastructure, ensuring high availability and data integrity.

This role is on-site.

Responsibilities

• Execute weekly server rebuilds for 21–30 nodes with zero data loss and minimal performance impact.
• Perform Hadoop-level pre/post validations covering cluster health, HDFS usage, replication, skew, and logs.
• Reconfigure and reintegrate rebuilt nodes back into the cluster.
• Coordinate hardware and OS-level tasks with Data Center Ops and Unix Admins.
• Provide weekday and rotational weekend support across BDH1 and BDH4 clusters.

Required Skills

• 8+ years of hands-on experience with the Hadoop ecosystem.
• Deep proficiency in HDFS, YARN, MapReduce, and HBase.
• Experience with log analysis, volume/block checks, and skew troubleshooting.
• Familiarity with open-source Hadoop distributions.
• Knowledge of production change controls.
• Ability to coordinate effectively with Data Center Ops and Unix Admins.
• Strong ability to work independently in a complex environment.

Preferred Skills

• Bachelor's degree in Computer Science or related field.

Key Skills

Education

Bachelor's degree