Description

Manage and administer Hadoop infrastructure to ensure high availability and performance.

Responsibilities

• Deploy and maintain Hadoop clusters, including node scaling and NameNode high availability configuration.
• Monitor cluster connectivity, performance metrics, and running jobs to ensure continuous uptime.
• Perform capacity planning by estimating HDFS storage requirements and determining cluster sizing.
• Manage resource security, backup and recovery tasks, and analyze Hadoop log files.
• Troubleshoot application errors and collaborate with database, network, BI, and application teams to resolve issues.

Required Skills

• 5+ years of experience in Big Data development and administration.
• Hands-on experience with AWS Hadoop environments.
• Proficiency in Java.
• Experience with Spark and Scala.
• Strong knowledge of Hive and SQL.
• Experience managing Hadoop cluster infrastructure and HDFS.
• Ability to perform capacity planning and resource management.
• Background in Big Data application troubleshooting.

Preferred Skills

• Experience with Android development.

Key Skills

Education

Any Graduate