Description

You will manage production job monitoring and system health for data processing workflows.

Responsibilities

• Monitor Spark jobs and system health continuously to ensure stability.
• Troubleshoot issues by analyzing Spark logs and using monitoring tools like Dynatrace.
• Resolve production incidents following established SOPs.
• Write small automation scripts in Python to assist with support tasks.
• Communicate technical problem statements clearly in client-facing scenarios.

Required Skills

• 3+ years of experience in production support or similar roles.
• Proficiency in Python, Scala, or Java.
• Hands-on experience with Hadoop, Spark, Kafka, and NiFi.
• Strong SQL skills for data querying and analysis.
• Experience debugging and reading Spark logs.
• Ability to use monitoring tools such as Dynatrace.
• Strong analytical and troubleshooting capabilities.
• Excellent verbal and written communication skills.
• Any Graduate degree.

Preferred Skills

• Knowledge of Postgres.
• Ability to develop automation scripts using Python.

Key Skills

Education

Any Graduate