Description

Design, build, and optimize terabyte-scale data pipelines and containerized platforms on AWS.

This role is hybrid.

Responsibilities

• Develop and maintain scalable data pipelines processing large-volume datasets.
• Migrate and manage infrastructure from EMR/EC2 to Kubernetes-based architectures.
• Build and manage CI/CD pipelines using GitLab and Bitbucket.
• Optimize code performance for high-throughput distributed systems.
• Integrate GenAI tools and AI agents into existing data workflows.

Required Skills

• 5+ years of experience with Kubernetes, including deployment and migration.
• Strong proficiency in Python, SQL, or Scala.
• Experience with AWS cloud platforms and containerized serverless architectures.
• Hands-on experience with CI/CD tools like GitLab and Bitbucket.
• Deep understanding of distributed systems and big data frameworks (EMR).
• Familiarity with Elasticsearch and data processing optimization.
• Exposure to GenAI, AI agents, or automation frameworks.

Preferred Skills

• AWS and/or Kubernetes certifications.
• Experience with Google Cloud or open-source ecosystems.

Key Skills

Education

Any Gradute