Description

You will manage and maintain the stability and performance of Hadoop infrastructure, including cluster deployment, monitoring, and capacity planning.

This role is on-site.

Responsibilities

• Deploy and maintain Hadoop clusters, adding or removing nodes using monitoring tools.
• Configure NameNode high availability and track all running Hadoop jobs.
• Perform capacity planning to estimate scaling requirements based on HDFS data needs.
• Manage cluster connectivity, performance monitoring, log reviews, and backup/recovery tasks.
• Troubleshoot application errors and implement preventative measures to stop recurrence.

Required Skills

• 7+ years of experience in Hadoop administration activities.
• 2-3 years of experience with Hadoop, Kubernetes, Kafka, and object storage.
• Hands-on experience with AWS Big Data services.
• Proficiency with Spark, Scala, Hive, Base, and Kudu.

Preferred Skills

• Experience with Minio, Ceph, or Apache Ozone.
• Knowledge of S3 and object storage technologies.

Education: Any Graduate degree.

Key Skills

Education

Any Graduate