Description

You will design, implement, and manage Hadoop infrastructure and the broader data ecosystem.

Responsibilities

• Design, implement, and maintain Hadoop clusters, including HDFS, YARN, and MapReduce components.
• Administer and monitor clusters to ensure high availability, reliability, and performance.
• Troubleshoot issues related to infrastructure, data ingestion, processing, and storage.
• Implement security measures including authentication, authorization, and encryption.
• Collaborate with DevOps to automate infrastructure provisioning, deployment, and management.

Required Skills

• 5+ years of experience designing and administering Hadoop clusters in production.
• Proficiency with HDFS, YARN, MapReduce, Hive, Spark, and HBase.
• Experience with cluster management tools like Apache Ambari or Cloudera Manager.
• Strong scripting skills in Bash and Python for automation.
• Hands-on experience with Apache Kafka or Apache NiFi for data ingestion.
• Solid understanding of Linux/Unix systems and networking concepts.
• Knowledge of SQL and core database concepts.
• Experience implementing security principles within Hadoop ecosystems.
• Bachelor's degree in Computer Science, IT, or equivalent work experience.

Preferred Skills

• Cloudera Certified Administrator for Apache Hadoop (CCAH).
• Hortonworks Certified Administrator (HCA).

Key Skills

Education

ANY GRADUATE