Description

Design, deploy, and maintain production-grade Amazon EKS clusters for petabyte-scale data processing. This role owns the Kubernetes platform within secure, air-gapped private VPCs, ensuring high availability and fault tolerance.

This role is hybrid.

Responsibilities

• Deploy and operate Kubernetes environments in restricted-access networks, including private container registries and package repositories.
• Optimize Karpenter consolidation and disruption policies to balance infrastructure efficiency and workload stability.
• Manage Spot and On-Demand instance strategies with robust interruption handling and recovery mechanisms.
• Configure persistent storage using Amazon EBS and EFS CSI Drivers to support high-performance data processing.
• Troubleshoot distributed systems issues across EKS, Karpenter, and Apache Spark, resolving scheduling bottlenecks and node provisioning delays.

Required Skills

• 10+ years of hands-on experience designing and supporting Kubernetes platforms in enterprise production environments.
• Deep expertise with Amazon EKS and cloud-native technologies.
• Strong experience with Kubernetes cluster autoscaling, specifically Karpenter.
• Proven experience supporting large-scale Apache Spark workloads and distributed systems.
• Strong troubleshooting and performance tuning skills across Kubernetes, AWS infrastructure, networking, and storage.
• Experience working within highly secure, restricted-access, or air-gapped environments.

Preferred Skills

• Kubernetes certifications (CKA, CKAD, or CKS) or AWS certifications.
• Experience contributing to open-source Kubernetes, Karpenter, or Apache Spark projects.

Key Skills

Education

Any Graduate