Description

Administer and optimize AWS-based data pipeline platforms, ensuring high availability for critical workloads.

This role is on-site.

Responsibilities

• Implement and maintain observability dashboards, alarms, and metrics to proactively prevent incidents.
• Lead incident response and root cause analysis (RCA), driving preventative improvements to reduce recurrence.
• Automate pipeline monitoring, scaling, and recovery workflows using Infrastructure-as-Code (IaC) and Python scripting.
• Mentor engineers on troubleshooting, observability, and automation best practices, improving runbooks for standardized response.

Required Skills

• Strong experience with AWS cloud services and big data platform operations.
• Hands-on expertise in Databricks and large-scale data pipeline environments.
• Proficiency in Python scripting and automation frameworks.
• Experience with Infrastructure-as-Code (IaC) tools and CI/CD processes.
• Strong knowledge of monitoring, observability, and operational support practices.
• Experience optimizing data platform scalability, performance, and reliability.
• Understanding of incident management, root cause analysis, and production support.

Preferred Skills

• Familiarity with SOX compliance and operational governance practices.

Key Skills

Education

Any Graduate