Description

You will manage the end-to-end installation, configuration, and maintenance of the Hadoop stack on Azure Cloud.

Responsibilities

• Install and configure the Hadoop stack end-to-end on Azure Cloud.
• Optimize Hadoop clusters to ensure security, reliability, and resource efficiency.
• Perform cluster monitoring, tuning, upgrades, and patch updates.
• Manage version control and troubleshoot Hadoop components including HDFS, YARN, MapReduce, Hive, HBase, and Spark.
• Automate cluster management using tools such as Salt, Ansible, Puppet, or Chef.

Required Skills

• 5+ years of experience in Hadoop administration and cluster management.
• Expertise in E2E installation and tuning of HDFS, YARN, MapReduce, Hive, HBase, and Spark.
• Proven experience provisioning and maintaining Hadoop clusters on Azure, AWS, or GCP.
• Experience with cluster automation using Salt, Ansible, Puppet, or Chef.
• Proficiency in managing Hadoop stacks in both on-premises and cloud environments.
• Strong understanding of cluster upgrades and patch management.
• Bachelor's degree in Computer Science.

Preferred Skills

• Experience with Jenkins, DevOps CI/CD, and containerization.
• Knowledge of ETL pipelines and troubleshooting.
• Experience with SQL and NoSQL databases.

Key Skills

Education

Bachelor's degree in Computer Science