Description

Manage the installation, configuration, and administration of Cloudera Hadoop clusters.

Deploy Cloudera Hadoop (CDP) clusters from scratch and optimize resource utilization.

Responsibilities

• Deploy and manage Cloudera Hadoop (CDP) clusters from scratch.
• Collaborate with developers to implement code and optimize cluster resource utilization.
• Automate runtime processes and manage data delivery setups, including Linux users and Kerberos principals.
• Monitor, troubleshoot, and tune Cloudera clusters, Spark, and MapReduce routines.
• Test and validate HDFS and Hive environments.

Required Skills

• 8+ years of experience in Hadoop administration.
• Hands-on experience with Cloudera installation, debugging, and tuning.
• Proficiency in Red Hat Linux administration, including security, configuration, and monitoring.
• Experience with PySpark and SparkQL.
• Strong knowledge of Linux OS and Unix Shell Scripting.
• Experience with AWS.
• Ability to test HDFS and Hive.

Preferred Skills

• Experience with MapReduce routine optimization.
• Exposure to Data Science tools like JupyterHub or data science workbenches.

Key Skills

Education

ANY GRADUATE