Description

Manage and scale large-scale Hadoop clusters and data infrastructure.

Responsibilities

• Install, configure, monitor, and troubleshoot Hadoop, HDFS, YARN, MapReduce, and Spark workloads.
• Deploy and scale infrastructure to support data pipelines, backups, recovery, and automated tasks.
• Perform capacity planning and execute system upgrades.
• Document installation processes, system designs, and operational procedures.

Required Skills

• 7+ years of experience with the Hadoop ecosystem.
• Hands-on experience managing Hive, Pig, HBase, Oozie, Flume, and ZooKeeper.
• Proficiency in Python and Shell scripting for automation and tooling.
• Strong Linux administration skills.
• Experience with Docker infrastructure.
• Ability to run Machine Learning pipelines using JupyterHub.
• Knowledge of SQL engines and performance tuning.
• Familiarity with Node.js and Samba.
• Proficiency with monitoring systems and diagnostic tools.

Key Skills

Education

Any Graduate