Description

You will manage and maintain the stability and performance of the Hadoop infrastructure in St. Louis, MO.

Responsibilities

• Deploy and maintain Hadoop clusters, including adding or removing nodes using monitoring tools.
• Configure NameNode high availability and track all running Hadoop jobs.
• Perform capacity planning to estimate requirements for scaling cluster capacity based on HDFS data needs.
• Manage cluster connectivity, performance monitoring, log reviews, and backup/recovery tasks.
• Troubleshoot application errors and implement preventative measures to stop recurrence.

Required Skills

• 7+ years of experience in Hadoop administration activities.
• 2-3 years of experience with Hadoop, Kubernetes, Kafka, and object storage.
• Experience with Spark, Scala, Hive, Base, and Kudu.
• Hands-on experience with AWS Big Data.
• Any Graduate degree.

Preferred Skills

• Experience with Minio, Ceph, or Apache Ozone.
• Knowledge of S3 and object storage technologies.

Key Skills

Education

Any Graduate