Description

You will install, configure, and maintain Hadoop clusters in production environments, managing ecosystem components like HDFS, YARN, Hive, Spark, HBase, and Kafka.

This role is on-site.

Responsibilities

• Manage and support Hadoop ecosystem components including HDFS, YARN, MapReduce, Hive, HBase, Spark, Sqoop, Oozie, Kafka, ZooKeeper, and Impala.
• Perform cluster monitoring, health checks, capacity planning, and resource optimization using tools such as Ambari, Cloudera Manager, Grafana, Nagios, or Prometheus.
• Configure and manage Hadoop security including Kerberos, Ranger, Knox, and LDAP/AD integration while managing user access and governance policies.
• Troubleshoot cluster, application, and performance-related issues in distributed systems and production support environments.
• Plan and execute Hadoop upgrades, patches, and migrations with minimal downtime, implementing backup and disaster recovery procedures.

Required Skills

• 5+ years of experience in Hadoop Administration with Apache Hadoop, Cloudera CDP/CDH, Hortonworks HDP, or MapR.
• Hands-on experience with HDFS, YARN, Hive, Spark, HBase, Kafka, and ZooKeeper.
• Proficiency in Linux/Unix administration and Shell Scripting.
• Basic Python scripting skills for automation tasks.
• Knowledge of Hadoop cluster architecture, resource management, and performance tuning.
• Experience with CI/CD and automation tools such as Jenkins and Ansible.
• Understanding of data warehousing and ETL concepts.

Preferred Skills

• Cloud platform exposure (AWS EMR, Azure HDInsight, Databricks, or GCP Dataproc).
• Knowledge of containerization technologies like Docker and Kubernetes.

Key Skills

Education

Bachelor's degree