Hadoop Administrator

Manage and maintain Hadoop clusters across cloud and on-premises environments. Configure platforms using AWS cloud native services.

Responsibilities

• Set up, configure, and implement security for Hadoop clusters using Kerberos.
• Implement data-at-rest encryption and manage data replication peers and policies.
• Deploy and support services including YARN, HDFS, ZooKeeper, Hive, Spark, and HBase.
• Collaborate with infrastructure, networking, and development teams to maintain system stability.
• Participate in a 24x7 rotating shift schedule, including weekends and public holidays.

Required Skills

• 5+ years of hands-on experience in Hadoop and system administration.
• Deep knowledge of Unix-based operating system internals.
• Experience with Cloudera CDP, CDH, and Hortonworks HDP distributions.
• Proficiency with Linux distributions including RedHat, CentOS, and Ubuntu.
• Ability to use Hadoop command line interface and perform data auditing.
• Scripting experience in Shell, Bash, or Python for automation and configuration management.
• Knowledge of Apache Sqoop, Ranger, SSL, and Atlas.

Preferred Skills

• Experience implementing data-in-transit encryption.