Description

You will administer and maintain Hadoop clusters to ensure high availability and optimal performance.

This role is on-site.

Responsibilities

• Manage, install, configure, and upgrade Cloudera Hadoop distributions.
• Monitor HDFS, Spark, and Kafka ecosystem components for system stability.
• Troubleshoot and resolve production issues across Hadoop, HDFS, Spark, and Kafka.
• Perform capacity planning, performance tuning, and cluster optimization.
• Collaborate with data engineering and operations teams to support distributed processing.

Required Skills

• 5+ years of hands-on experience administering Hadoop clusters.
• Proven expertise in HDFS architecture, monitoring, and troubleshooting.
• Hands-on experience with Cloudera installation, configuration, and upgrades.
• Experience using Spark and PySpark for distributed data processing.
• Strong troubleshooting skills across Hadoop ecosystem components like Kafka and Spark.
• Understanding of Hadoop security concepts, including authentication and authorization.
• Experience in performance tuning and capacity planning for big data platforms.

Key Skills

Education

Any Graduate