Description

You will own production support, optimization, and orchestration of critical data pipelines and workflows.

This role is on-site.

Responsibilities

• Provide production support for data pipelines, ensuring high availability and timely incident resolution.
• Monitor, troubleshoot, and optimize PySpark-based data processing jobs.
• Manage and orchestrate workflows using Control-M, covering scheduling, monitoring, and error handling.
• Perform root cause analysis and implement permanent fixes for recurring production issues.

Required Skills

• 7+ years of professional experience in data engineering or analytics application support.
• Proficiency in PySpark for data processing job management and troubleshooting.
• Solid experience with AWS services, including EKS, EMR, S3, Glue, and Step Functions.
• Hands-on experience with Control-M for workflow orchestration.
• Strong skills in SQL (Basic + Advanced), Python, and Hive.
• Working knowledge of MongoDB and Snowflake for production data management.
• Experience with log monitoring and analysis using Elasticsearch Service (ESS).
• Understanding of Data Modelling Fundamentals and ETL processes.

Key Skills

Education

Any Graduate