Description

You will design, deploy, and maintain production-grade Amazon EKS clusters for petabyte-scale data processing.

This role is hybrid.

Responsibilities

• Operate in air-gapped private VPCs, managing secure package repositories and container registries without internet access.
• Debug complex distributed systems issues across EKS, Karpenter, and Spark, including scheduling bottlenecks and cascading failures.
• Implement Karpenter consolidation and disruption policies to balance cost optimization with job resiliency.
• Configure persistent volume claims and provision container-native storage using Amazon EBS and EFS CSI drivers.
• Design fault-tolerant architectures with retry strategies, checkpointing, and anomaly detection to minimize re-computation.

Required Skills

• 5+ years of experience with Kubernetes, Amazon EKS, and distributed systems.
• Deep knowledge of Karpenter for node scaling and interruption handling.
• Experience with Apache Spark and data engineering platforms.
• Proficiency in managing private VPC environments and air-gapped configurations.
• Strong understanding of AWS storage solutions (EBS, EFS) and networking.
• Bachelor's degree in Computer Science or related field.

Preferred Skills

• Kubernetes certification (CKA, CKAD, or CKS) and AWS certifications.
• Active contributions to open-source Kubernetes, Karpenter, or Spark projects.
• Familiarity with FinOps practices and cost optimization at scale.

Key Skills

Education

Bachelor's degree