Description

You will manage and maintain Hadoop clusters to ensure data availability and system performance.

Responsibilities

• Perform capacity planning and estimate requirements for scaling Hadoop cluster resources.
• Monitor and maintain production clusters to ensure stability.
• Ingest web server logs using Flume into HDFS.
• Extract data from heterogeneous sources into HDFS for processing.
• Troubleshoot backup and restore issues while monitoring system performance.

Required Skills

• 5+ years of experience in Hadoop administration.
• Strong proficiency in Hadoop Cluster management and Hadoop HDFS.
• Experience with Hive for data warehousing and schema ingestion.
• Ability to develop Map-Reduce programs to cleanse data.
• Hands-on experience with Flume for data ingestion.
• Skills in extracting data from heterogeneous sources.
• System performance monitoring and troubleshooting capabilities.

Key Skills

Education

Any Graduate