Description

Key Skills: AWS, Observability, Big Data, Databricks, Monitoring, Python, IAC, SOX, CICD

Roles and Responsibilities:

• Administer and optimize data pipeline platforms and environments to ensure high availability and reliability for business-critical workloads.
• Implement and maintain monitoring and observability dashboards, alarms, and metrics to proactively prevent incidents.
• Lead incident response and root cause analysis (RCA), and drive preventative improvements to reduce recurrence.
• Automate pipeline monitoring, scaling, and recovery workflows using infrastructure-as-code and scripting.
• Mentor engineers on troubleshooting, observability, and automation best practices, and improve runbooks/playbooks for standardized response.

Skills Required:

• Strong experience with AWS cloud services and big data platform operations.
• Hands-on expertise in Databricks and large-scale data pipeline environments.
• Strong knowledge of monitoring, observability, and operational support practices.
• Proficiency in Python scripting and automation.
• Experience with Infrastructure-as-Code (IaC) tools and automation frameworks.
• Familiarity with CI/CD processes and deployment automation.
• Understanding of incident management, root cause analysis, and production support activities.
• Experience optimizing data platform scalability, performance, and reliability.
• Knowledge of cloud infrastructure, distributed systems, and big data technologies.
• Familiarity with SOX compliance and operational governance practices is preferred.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication, mentoring, and stakeholder collaboration abilities.

Education: Bachelor's degree in Computer Science, Information Technology, Engineering, Data Engineering, or a related field

Key Skills

Education

Any Graduate