Description

You will manage Hadoop production environments, focusing on administration, troubleshooting, and optimization.

Responsibilities

• Install, configure, and maintain Hadoop distributions, primarily Cloudera, in Linux and virtual environments.
• Manage HDFS, Yarn, Hive, LLAP, Druid, Impala, Spark, Kafka, and HBase.
• Ensure high availability for NameNodes and schedule backups for the Hadoop ecosystem.
• Handle data movement in and out of clusters and support Data Lake/Warehouse design.
• Troubleshoot infrastructure issues and implement software lifecycle methodologies.

Required Skills

• 10+ years of intermediate to expert experience in Hadoop production environments.
• Hands-on administration of Hadoop in Linux and virtual environments.
• Expert knowledge of Hadoop ecosystem components (HDFS, Yarn, Hive, Spark, Kafka, HBase, Impala).
• Proficiency with Cloudera Work Bench and Cloudera distributions.
• Strong scripting experience in a Linux environment.
• Thorough understanding of Hadoop architecture and troubleshooting.
• Bachelor's degree in Information Systems, Engineering, Computer Science, or related field.
• Experience with configuration management, deployment, and data movement.

Key Skills

Education

Bachelor's degree in Information Systems, Engineering