Description

You will manage the implementation, maintenance, and scaling of Hadoop infrastructure.

Responsibilities

• Implement and administer Hadoop infrastructure, collaborating with systems engineering to deploy new hardware and software environments.
• Provision new users by setting up Linux users, Kerberos principals, and testing access for HDFS, Hive, HBase, and Yarn.
• Maintain clusters by adding or removing nodes using tools like Cloudera Manager Enterprise.
• Perform cluster tuning, capacity planning, and monitoring of job performance, connectivity, and security.
• Manage file systems, monitor HDFS, and review Hadoop log files.

Required Skills

• 3+ years of Linux system administration.
• 3+ years of Hadoop infrastructure administration.
• Experience with Hadoop distributions such as Hortonworks or MapR.
• Experience with HDFS, Hive, HBase, and Yarn.
• Knowledge of Kerberos principal setup.
• Experience with Cloudera Manager Enterprise or similar cluster management tools.
• Ability to perform performance tuning for Hadoop MapReduce routines.
• Bachelor's degree in Computer Science or a related discipline.

Key Skills

Education

ANY GRADUATE