Description

You will provide production support and monitoring for data processing pipelines.

Responsibilities

• Monitor Spark jobs and system health continuously to ensure stability.
• Troubleshoot and resolve production issues by analyzing Spark logs and following SOPs.
• Use monitoring tools like Dynatrace to maintain system visibility.
• Articulate technical problem statements clearly in client-facing scenarios.
• Develop small automation scripts in Python to assist with support tasks.

Required Skills

• 3+ years of experience in production support or similar roles.
• Hands-on experience with Spark, Scala, and Kafka.
• Proficiency in Python and Java.
• Strong SQL skills for data querying and analysis.
• Experience debugging and analyzing Spark logs.
• Strong analytical and troubleshooting capabilities.
• Excellent verbal and written communication skills.
• Ability to provide flexible project coverage and monitoring support.

Preferred Skills

• Knowledge of Postgres.
• Experience with Dynatrace.

Key Skills

Education

Any Graduate