Description

You will manage the end-to-end installation, configuration, and maintenance of the Hadoop stack on Azure Cloud.

This role is on-site.

Responsibilities

• Install and configure the Hadoop stack end-to-end on Azure Cloud.
• Optimize clusters for security, reliability, and resource efficiency.
• Perform cluster monitoring, tuning, upgrades, and patch management.
• Troubleshoot Hadoop components including HDFS, YARN, MapReduce, Hive, HBase, and Spark.

Required Skills

• 5+ years of experience in Hadoop administration and cluster management.
• Expertise in end-to-end installation and tuning of HDFS, YARN, MapReduce, Hive, HBase, and Spark.
• Proven experience provisioning and maintaining Hadoop clusters on Azure, AWS, or GCP.
• Experience with cluster automation using Salt, Ansible, Puppet, or Chef.
• Proficiency in managing Hadoop stacks in on-premises and cloud environments.
• Bachelor's degree in Computer Science.

Preferred Skills

• Experience with Jenkins, DevOps CI/CD, and containerization.
• Knowledge of ETL pipelines and troubleshooting.

Key Skills

Education

Bachelor's degree in Computer Science