Description

You will build and operate automation tools for large-scale data and compute infrastructure, focusing on process automation and self-serve resource provisioning.

Responsibilities

• Develop automation tools to support massive data and compute infrastructure operations.
• Create self-serve tools enabling tenants to provision Hadoop resources and environments.
• Enhance the usability, reliability, and scalability of open-source Apache Hadoop services.
• Manage the SDLC for infrastructure and platform automation tooling using CI/CD.
• Deliver platform improvements within Agile team cadences.

Required Skills

• 3+ years of Infrastructure as Code (IaC) experience with Ansible, Chef, or Terraform.
• Systems programming proficiency in Python, Go, or Java.
• Experience automating deployments within the Hadoop ecosystem (HDFS, HBase, Hive, Spark, Oozie).
• Hands-on experience with Kubernetes and container technologies.
• Proficiency with workflow automation tools like Airflow or Argo.
• Experience managing CI/CD pipelines using Jenkins or TeamCity.
• Solid understanding of Linux operating systems, shell scripting, and OS troubleshooting.
• Knowledge of Chaos Engineering or infrastructure testing strategies.
• Degree in Computer Science, Engineering, or equivalent work experience.

Key Skills

Education

Any Graduate