Description

Manage and scale Hadoop clusters in production environments operating on 18/5 or 24/5 schedules.

Responsibilities

• Scale production clusters and manage memory, queue allocation, and distribution across Hadoop and Cloud environments.
• Implement performance optimizations and manage patch upgrades for cluster stability.
• Monitor Hadoop systems using standard monitoring tools to ensure availability and performance.
• Oversee data workflows using Sqoop, Oozie, and other external tools.

Required Skills

• 5+ years of experience in Hadoop administration, preferably with Hortonworks or Open Distribution.
• Deep expertise in HDFS, Hive, Spark, and HBase.
• Experience with workflow orchestration using Oozie or Airflow.
• Proficiency in SQL and HQL for data manipulation and querying.
• Hands-on experience with security frameworks: Kerberos, TLS, Ranger, and data encryption.
• Strong understanding of Linux and scripting for automation and maintenance.
• Competency in at least one programming language.
• Experience with Sqoop for data transfer and monitoring tools.

Preferred Skills

• Experience with Kafka for streaming data integration.

Key Skills

Education

Any Gradute