Description

You will ensure the reliability, scalability, and performance of systems supporting Data Engineering Projects.

Responsibilities

• Design and engineer highly scalable and high availability systems for high throughput workloads.
• Develop, deploy, and manage monitoring systems, setting up alerts to proactively identify and resolve issues.
• Automate routine tasks such as deployments, monitoring, and policy enforcement using suitable frameworks.
• Optimize system performance by identifying bottlenecks and implementing appropriate solutions.
• Respond to system outages, perform root cause analysis, and implement fixes to prevent future incidents.

Required Skills

• 6+ years of hands-on experience maintaining large scale, high availability Data engineering solutions.
• Expertise with cloud platforms, specifically Azure.
• Proficiency in Cloud infrastructure and CI/CD frameworks for Infrastructure as Code (IaC) using Terraform, ARM, and YAML.
• Hands-on experience with cloud native containerization and deployment using Docker and Kubernetes (k8s).
• Experience with large scale Azure DevOps and Azure PaaS components.
• Tool knowledge including Argo, Terraform (CLI), Azure-CLI, Kubectl, Flux, Helm, Argo (Events and workflows), Istio, Grafana, and YAML coding/debugging.
• Kubernetes administration skill set.
• Programming experience in Python or Go.
• Deep understanding of Service Level Objectives (SLOs), Service Level Indicators (SLIs), and error budgeting.

Key Skills

Education

Any Graduate