Description

Lead the administration and management of the Hadoop ecosystem in Foster City, CA.

Responsibilities

• Manage Hadoop clusters using Hortonworks or Open Distribution.
• Maintain HDFS, Hive, and HBase environments for stability and performance.
• Oversee data processing workflows using Spark and orchestration tools like Oozie or Airflow.
• Implement security protocols including Kerberos, TLS, Ranger, and data encryption.

Required Skills

• 5+ years of experience in Hadoop administration.
• Proficiency with HDFS, Hive, and HBase.
• Experience with Spark and workflow orchestration via Oozie or Airflow.
• Practical knowledge of Kerberos, TLS, Ranger, and data encryption methods.
• Intermediate proficiency in SQL and HQL.
• Working knowledge of Kafka.
• Strong understanding of Linux environments.
• Scripting skills for automation.

Preferred Skills

• Experience with Hortonworks or Open Distribution.

Key Skills

Education

Any Gradute