Description

You will manage the entire lifecycle of the Hadoop ecosystem.

Responsibilities

• Install, configure, tune, and troubleshoot the full Hadoop stack, including HDFS, YARN, MapReduce, Hive, HBase, and Spark.
• Provision and maintain Hadoop clusters across on-premises environments and major clouds (Azure, AWS, GCP).
• Monitor and tune Hadoop cluster resources to ensure optimal performance and reliability.
• Perform cluster upgrades, patch updates, and version control management.

Required Skills

• 5+ years of experience administering Hadoop environments.
• Expertise in Hadoop components (HDFS, YARN, MapReduce, Hive, HBase, Spark).
• Experience managing clusters on Azure, AWS, or GCP.
• Proficiency with configuration management tools such as Salt, Ansible, or Puppet.
• Understanding of DevOps principles and Jenkins.
• Experience with SQL and NoSQL databases.
• Familiarity with ETL pipeline troubleshooting.

Key Skills

Education

Any Gradute