Description

You will manage and maintain Hadoop clusters and the associated data ecosystem.

This role is remote.

Responsibilities

• Troubleshoot Hadoop technologies including HDFS, MapReduce, YARN, Hive, HBase, Spark, Kafka, and Impala.
• Deploy and maintain clusters, managing node additions and removals using Ganglia, Nagios, or Cloudera Manager.
• Execute administrative tasks such as user access management, security management, node rebalancing, patching, and cluster upgrades.
• Manage resource pool allocation via Ambari for Hortonworks environments and configure security protocols using Kerberos, Knox, and Ranger.
• Automate package installation across multiple nodes using Ansible and verify YAML and Python scripts.

Required Skills

• 5+ years of experience in Hadoop administration.
• Proficiency with HDFS, MapReduce, YARN, Hive, HBase, and ZooKeeper.
• Experience with Spark, Kafka, Impala, Storm, Tez, Sqoop, and BeeLine.
• Hands-on experience with Ansible, YAML, and Python for automation.
• Knowledge of UC4 for automated job scheduling.
• Experience maintaining security with Kerberos, Knox, and Ranger.
• Ability to install and manage platform-level tools including SAS, Informatica, Presto, and R.
• Bachelor’s degree in Computer Science or a related Information Technology field.

Key Skills

Education

Any Graduate