Description

Manage and optimize Hadoop production environments. Ensure high availability and efficient data movement across clusters.

Responsibilities

• Install, configure, and manage Hadoop distributions, primarily Cloudera, in Linux and virtualized environments.
• Maintain HDFS, YARN, Hive, Impala, Spark, Kafka, HBase, and Cloudera Workbench performance and stability.
• Implement high availability for NameNodes and schedule backups for the Hadoop ecosystem.
• Design and develop Data Lake and Data Warehousing solutions.
• Troubleshoot infrastructure issues and improve existing DB and Hadoop setups.

Required Skills

• 5+ years of intermediate experience in Hadoop production environments.
• Expert knowledge of Hadoop architecture and ecosystem components (HDFS, YARN, Hive, Impala, Spark, Kafka, HBase).
• Hands-on experience with Cloudera distribution management.
• Strong Linux scripting and configuration management skills.
• Experience with data movement in and out of Hadoop clusters.
• Bachelor's degree in Information Systems, Engineering, Computer Science, or related field.
• Ability to review infrastructure and determine areas for improvement.

Preferred Skills

• Experience with Druid and LLAP.
• Familiarity with project management tools such as MS Project.

Key Skills

Education

Bachelor's degree in Information Systems, Engineering, Computer Science