Description

Manage and optimize large-scale production big data systems to ensure stability and performance.

Responsibilities

• Run and maintain Big Data production environments, ensuring high availability.
• Design and implement automated pipelines to reduce manual operational effort.
• Debug and optimize code to improve system performance and reliability.
• Collaborate with development, operations, and product teams to prioritize technical requirements.
• Manage software release and change management processes within ITSM/ITIL frameworks.

Required Skills

• 5+ years of experience running Big Data production environments.
• Hands-on expertise with Hadoop, Hive, Spark, NiFi, and Impala.
• Proficiency in Linux administration and SQL or Oracle fundamentals.
• Strong scripting, pipeline management, and software design capabilities.
• Knowledge of ITSM/ITIL processes for change management.
• Systematic problem-solving and debugging skills for complex production issues.
• Ability to manage stakeholder needs and make decisions under urgency.

Preferred Skills

• Experience with CI/CD tools including Git, Bitbucket, Jenkins, and Maven.
• Proven track record of designing CI/CD flows to automate code deployment from dev to prod.

Key Skills

Education

Any gradudate