Description

You will build and develop tools to operate and support massive data and compute infrastructure through aggressive process automation.

Responsibilities

• Build tools to support large-scale data and compute infrastructure via process automation.
• Develop self-serve tools for tenants to provision Hadoop resources and environments.
• Improve the usability, reliability, and scalability of open-source Apache Hadoop services.
• Automate deployments of technologies within the Hadoop ecosystem.
• Manage the SDLC of infrastructure and platform automation tooling using CI/CD.

Required Skills

• 5+ years of professional experience.
• Infrastructure as Code (IaC) experience using Ansible, Chef, or Terraform.
• Systems programming proficiency in Python, Go, or Java.
• Hands-on experience with the Hadoop ecosystem, including HDFS, HBase, Hive, Spark, and Oozie.
• Experience with Cloud Native technologies, specifically Kubernetes and Containers.
• Solid understanding of Linux operating systems, shell scripting, and OS troubleshooting.
• Experience with workflow automation tools such as Airflow or Argo.
• Experience with CI/CD tools like Jenkins or TeamCity.
• Practical experience with Chaos Engineering or infrastructure testing strategies.
• Degree in Computer Science, Engineering, or equivalent work experience.

Key Skills

Education

Any Graduate