Description

Design, deploy, and maintain production-grade Amazon EKS clusters optimized for petabyte-scale data processing, ensuring high availability and fault tolerance.

This role is hybrid.

Responsibilities

• Manage Kubernetes environments within secure, air-gapped private VPCs, including administration of private container registries and package repositories.
• Troubleshoot complex distributed systems issues across EKS, Karpenter, and Apache Spark, addressing scheduling bottlenecks and node provisioning delays.
• Implement Karpenter consolidation and disruption policies to balance infrastructure efficiency, cost management, and workload stability.
• Define and enforce ResourceQuotas, LimitRanges, and PriorityClasses to ensure efficient resource allocation and prevent contention.
• Configure persistent storage solutions using Amazon EBS and EFS CSI Drivers to support high-performance data processing workloads.

Required Skills

• 5+ years of hands-on experience designing and supporting Kubernetes platforms in enterprise production environments.
• Deep expertise with Amazon EKS and cloud-native technologies.
• Strong experience with Kubernetes cluster autoscaling solutions, specifically Karpenter.
• Proven experience supporting large-scale Apache Spark workloads and distributed systems.
• Strong troubleshooting and performance tuning skills across Kubernetes, AWS infrastructure, networking, and storage.
• Experience working within highly secure, restricted-access, or air-gapped environments.
• Strong understanding of Kubernetes resource management, scheduling, observability, and production operations.

Preferred Skills

• Kubernetes certifications (CKA, CKAD, or CKS) or AWS certifications.
• Knowledge of FinOps methodologies and cloud cost optimization at scale.
• Background supporting data engineering, analytics, or large-scale data platform environments.

Key Skills

Education

Any Graduate