Description

Manage the stability, automation, and performance of the Hadoop platform.

Responsibilities

• Manage platform incidents and perform root cause analysis by deep diving into client logs and partnering with vendors.
• Monitor cluster health and performance using tools like Prometheus, Splunk, and Thousand Eyes.
• Configure and tune Hadoop ecosystem components including HDFS, YARN, Hive, HBase, Spark, and HPOS.
• Execute platform upgrades, patches, and disaster recovery failover/fallback procedures.
• Automate routine activities and monitoring opportunities using Unix scripting and Autosys.

Required Skills

• 5+ years of experience in Hadoop administration or a similar infrastructure role.
• Strong knowledge of the Hadoop ecosystem: Hive, HBase, Spark, and Hue.
• Proven experience with monitoring tools such as Prometheus, Splunk, SiteScope, or Thousand Eyes.
• Proficiency in Unix scripting for automation and task execution.
• Experience using Autosys or similar job schedulers for routine platform activities.
• Background in technology incident and problem management.
• Ability to perform cluster health validation and manage change request processes.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate