Description

You will manage and automate cloud infrastructure, deployment pipelines, and data platform orchestration on AWS.

Responsibilities

• Provision and manage compute, storage, and database resources including Kubernetes clusters, EKS, RDS, and S3.
• Deploy and manage Apache Airflow, Kafka, and Spark clusters.
• Build and maintain CI/CD pipelines using Terraform modules for infrastructure and application deployments.
• Configure observability, logging, and monitoring stacks to integrate with deployment pipelines.
• Implement authentication workflows using OKTA (OIDC) and Kerberos for web services and Kafka.

Required Skills

• 5+ years of engineering and consulting experience.
• Hands-on experience with Kubernetes (KOPS, ingress controllers, etcd, CoreDNS).
• Proficiency with Terraform for infrastructure as code.
• Experience managing Kafka and Apache Airflow environments.
• Working knowledge of at least one programming language: Node.js, Java, or Python.
• Experience with logging and observability tools such as Logstash, Elasticsearch, Kibana, Graphite, Splunk, or HDFS.
• Ability to integrate pipelines with ALM tools like Jira and Bamboo.
• Experience working in Agile teams.

Preferred Skills

• Experience with configuration management tools such as Chef, Ansible, or Puppet.

Key Skills

Education

Any Graduate