Description

You will manage, maintain, and scale Hadoop clusters and their surrounding ecosystems.

Responsibilities

• Deploy Hadoop clusters, manage node scaling, and configure NameNode high availability.
• Perform storage management, performance tuning, and capacity planning for Hadoop clusters and MapReduce routines.
• Install, patch, and upgrade software while managing data ingestion using Sqoop or Flume.
• Design and develop Data Lake and Data Warehousing architectures.
• Configure Hadoop security, specifically Kerberos integration, and manage job scheduling.
• Support a 24/7 environment via an on-call rotation.

Required Skills

• 5+ years of experience in a Hadoop production environment.
• Expert knowledge of Hadoop ecosystem components including HDFS, YARN, Hive, LLAP, Druid, Impala, Spark, Kafka, and HBase.
• Hands-on experience with Hadoop administration in Linux and virtual environments.
• Proficiency in Cloudera distributions and Cloudera Workbench.
• Strong Linux scripting skills for automation and administration.
• Experience with data movement and ingestion tools like Sqoop or Flume.
• Ability to design and implement data models based on recognized standards.
• Bachelor's degree in Information Systems, Engineering, Computer Science, or a related field.

Key Skills

Education

Bachelor's degree