Description

What You'll Do:

• Administer and manage Cloudera CDP/CDH clusters across production and non-production environments.
• Install, configure, patch, upgrade, and maintain Hadoop ecosystem services including HDFS, YARN, Hive, Spark, Kafka, HBase, Impala, Solr, Oozie, Hue, Ranger, Atlas, Knox, and ZooKeeper.
• Perform platform upgrades, cluster expansion, health checks, and lifecycle management activities.
• Optimize Hadoop cluster performance through tuning of HDFS, YARN, Hive, Spark, Kafka, HBase, and Impala workloads.
• Develop and maintain capacity planning models for storage, compute, and resource utilization.
• Implement and manage security controls including Kerberos, Ranger, Knox, TLS/SSL, LDAP/AD integration, and HDFS encryption.
• Design, implement, and test backup, disaster recovery, failover, and cross-cluster replication strategies.
• Automate infrastructure deployment, configuration management, and operational processes using Ansible, Python, Shell scripting, and Terraform.
• Monitor platform health using Cloudera Manager, Prometheus, Grafana, Splunk, and related monitoring solutions.
• Participate in 24x7 on-call support and provide L3 support for critical production incidents.
• Conduct root cause analysis (RCA) and implement corrective and preventive actions.
• Collaborate with Data Engineering, Security, Infrastructure, and Operations teams to ensure platform stability and scalability.
• Mentor junior team members and contribute to operational best practices, documentation, and runbooks.

Expertise You'll Bring:

• 5+ years of hands-on experience in Hadoop/Big Data Administration.
• Strong experience with Cloudera CDH/CDP environments and Cloudera Manager.
• Expertise in Hadoop ecosystem technologies including HDFS, YARN, Hive, Impala, Spark, Kafka, HBase, Solr, Oozie, Hue, and ZooKeeper.
• Experience managing security frameworks such as Kerberos, Ranger, Atlas, Knox, TLS/SSL, and LDAP/Active Directory integration.
• Proven experience performing Hadoop platform upgrades, migrations, and production support activities.
• Strong knowledge of Linux system administration, networking, storage concepts, and performance tuning.
• Experience with backup, disaster recovery, replication, and high-availability architectures.
• Strong scripting and automation skills using Python, Bash, and Ansible.
• Familiarity with Terraform, Jenkins, GitLab CI/CD, and Infrastructure-as-Code practices.
• Hands-on experience with monitoring tools such as Cloudera Manager, Prometheus, Grafana, ELK/EFK, and Splunk.
• Excellent troubleshooting, incident management, and problem-solving skills.
• Strong communication skills and ability to work effectively in cross-functional teams.
• Experience with CDP Public Cloud, AWS, Azure, or GCP.
• Knowledge of Iceberg, Delta Lake, Hudi, Trino/Presto, Airflow, and Flink.
• Experience with Kubernetes, OpenShift, Helm, and containerized data platforms.
• Cloudera, RHCSA/RHCE, or Kafka-related certifications

Key Skills

Education

Any Graduate