Description

You will manage and administer Hadoop clusters ranging from POC to production environments across 100 nodes, covering both on-premise and cloud infrastructure.

Responsibilities

• Manage day-to-day operations of data servers and overall infrastructure.
• Collaborate with database, network, BI, and application teams to ensure high availability and performance.
• Execute backup, recovery, resource management, and security management tasks.
• Troubleshoot application errors and implement preventative measures.
• Design, instantiate, and maintain data storage setups for analytics and data science.

Required Skills

• 5+ years of administration experience in big data integration technologies, focusing on Cloudera or Hortonworks.
• Deep knowledge of HDFS, MapReduce, Hive, Hue, Pig, Flume, Oozie, Sqoop, and Apache Hadoop 2.6.
• Experience with CDH5 or higher, Spark, Solr, Storm, Knox, and Cloudera Manager.
• Proficiency with Hive, Spark, Kudu, Kafka, and AWS Cloud.
• Hands-on experience with Red Hat, Oracle, Unix/Linux, Kubernetes, and OpenShift.
• Experience managing security configurations including Active Directory, LDAP, SAML, Kerberos, SSL, and Encryption.
• Familiarity with Ranger/Sentry.

Preferred Skills

• Bachelor's Degree in Computer Science or equivalent.

Key Skills

Education

Bachelor's Degree in Computer Science