Description

You will manage and maintain large-scale Big Data and streaming platforms.

Responsibilities

• Monitor Hadoop, Spark, HBase, and Kafka platforms following established runbooks and SOPs.
• Perform cluster maintenance and implement changes according to documented installation and validation plans.
• Troubleshoot and debug platform services and application issues to identify root causes.
• Conduct root cause analysis for major production incidents and implement proactive reliability measures.
• Automate routine tasks and manual workflows using scripting and automation tools.

Required Skills

• 5+ years of experience as a Site Reliability Engineer for Hadoop or Kafka platforms.
• Deep knowledge of Hadoop core components and platforms including Spark and HBase.
• Thorough understanding of Kafka architecture, including producers, consumers, topics, and partitions.
• Proficiency in writing Ansible playbooks to automate manual tasks.
• Strong scripting skills in Python and Shell.
• Solid understanding of Unix/Linux system internals and networking.
• Experience managing and troubleshooting distributed systems.

Preferred Skills

• Experience with Ansible automation frameworks.

Key Skills

Education

Any Graduate