Description

You will manage and scale Hadoop clusters in production environments, ensuring stability and performance across Hadoop and Cloud ecosystems.

This role is on-site.

Responsibilities

• Scale production clusters and manage memory, queue allocation, and distribution.
• Implement performance optimizations and manage patch upgrades for cluster stability.
• Monitor Hadoop systems using standard tools to ensure availability and performance.
• Oversee data workflows using Sqoop, Oozie, and other external tools.

Required Skills

• 5+ years of experience in Hadoop administration (Hortonworks or Open Distribution preferred).
• Deep expertise in HDFS, Hive, Spark, and HBase.
• Experience with workflow orchestration using Oozie or Airflow.
• Proficiency in SQL and HQL for data manipulation and querying.
• Hands-on experience with security frameworks: Kerberos, TLS, Ranger, and data encryption.
• Strong understanding of Linux and scripting for automation and maintenance.
• Competency in at least one programming language.
• Experience with Sqoop for data transfer.

Preferred Skills

• Experience with Kafka for streaming data integration.

Key Skills

Education

Any Gradute