Description

Manage the end-to-end installation, configuration, and maintenance of Hadoop stacks across on-premises and cloud environments.

This role is hybrid.

Responsibilities

• Install and configure the Hadoop stack end-to-end on Azure Cloud.
• Provision and maintain Hadoop clusters on-premises and in cloud environments such as Azure, AWS, or GCP.
• Optimize, tune, and troubleshoot Hadoop components including HDFS, YARN, MapReduce, Hive, HBase, and Spark.
• Manage cluster upgrades, patch updates, and version control.
• Automate cluster management using configuration management tools.

Required Skills

• 5+ years of experience in Hadoop administration.
• Expertise in HDFS, YARN, MapReduce, Hive, HBase, and Spark.
• Hands-on experience with Azure, AWS, or GCP cloud environments.
• Experience with cluster automation using Ansible, Puppet, Chef, or Salt.
• Proficiency in monitoring and tuning Hadoop cluster resources.
• Experience ensuring security and reliability of Hadoop environments.

Preferred Skills

• Experience with Jenkins, DevOps CI/CD, and containerization.
• Knowledge of ETL pipeline troubleshooting.
• Experience with SQL and NoSQL databases.

Key Skills

Education

Any Graduate