Description

You will design, implement, and manage Hadoop infrastructure and the surrounding data ecosystem.

Responsibilities

• Design and maintain Hadoop clusters, including HDFS, YARN, and MapReduce components.
• Administer and monitor clusters to ensure high availability, reliability, and performance.
• Troubleshoot infrastructure issues related to data ingestion, processing, and storage.
• Implement security measures including authentication, authorization, and encryption.
• Automate infrastructure provisioning and deployment processes in collaboration with DevOps teams.

Required Skills

• 5+ years of experience designing and administering Hadoop clusters in production.
• Proficiency with HDFS, YARN, MapReduce, Hive, Spark, and HBase.
• Strong scripting skills in Bash and Python for automation and troubleshooting.
• Solid understanding of Linux/Unix systems and networking concepts.
• Working knowledge of SQL and database concepts.
• Experience with data ingestion tools such as Apache Kafka or Apache NiFi.
• Experience using cluster management tools like Apache Ambari or Cloudera Manager.
• Bachelor's degree in Computer Science, Information Technology, or equivalent work experience.

Preferred Skills

• Cloudera Certified Administrator for Apache Hadoop (CCAH).
• Hortonworks Certified Administrator (HCA).

Key Skills

Education

ANY GRADUATE