Description

You administer and optimize large-scale Hadoop infrastructure, ensuring high availability, security, and performance for data engineering and warehouse queries.

This role is hybrid.

Responsibilities

• Implement and maintain Hadoop clusters, managing node creation, removal, and capacity planning using Cloudera Manager, Ganglia, and Nagios.
• Tune Hadoop clusters and MapReduce/Spark routines to optimize query performance and resource utilization.
• Manage user access, including Linux users, Kerberos principals, and HDFS/Hive permissions, while ensuring cluster security and connectivity.
• Collaborate with engineering teams to deploy new hardware, software environments, and OS/Hadoop patches, serving as the primary vendor escalation point.
• Perform DBA duties including data modeling, database backup/recovery, connectivity security, and automation of manual tasks.

Required Skills

• 5-8 years of Hadoop Administration experience with 3-5 years of DBA experience.
• Deep expertise in Hadoop ecosystem components: HDFS, Hive, Pig, MapReduce, and Spark.
• Strong proficiency in Linux system administration and command-line operations.
• Experience with monitoring and management tools such as Cloudera Manager Enterprise, Ganglia, Nagios, and Dell OpenManage.
• Hands-on experience with SQL databases and tools like Toad.
• Knowledge of cloud platforms (AWS, Azure) and object storage (S3).
• Bachelor's degree in a relevant technical field.

Key Skills

Education

Bachelor's degree