Description

You will architect, provision, and maintain scalable, secure cloud environments on AWS, optimized for data-intensive workloads. This role owns the infrastructure lifecycle and ensures high availability for batch and streaming data pipelines.

This role is on-site.

Responsibilities

• Architect and provision cloud infrastructure using Terraform, establishing IAM guardrails, security policies, and resource tagging standards.
• Administer and patch distributed data processing frameworks including Apache Spark, Airflow, Kafka, and Hadoop.
• Build and maintain CI/CD automation pipelines using GitHub Actions, GitLab, or Jenkins to facilitate environment provisioning.
• Monitor platform health, troubleshoot system bottlenecks, and optimize costs for compute (EC2, EMR) and storage (S3) resources.
• Manage database administration lifecycles, including backup, recovery, query optimization, and HA/DR strategies for cloud-native data stores.

Required Skills

• 12+ years of experience as a Cloud Platform Engineer, Data Platform Administrator, or DevOps Engineer.
• Deep hands-on administration experience with AWS services, specifically EC2, EMR, and S3.
• Strong proficiency with Infrastructure as Code tools, primarily Terraform.
• Experience with containerization using Docker and CI/CD tools like GitHub Actions, GitLab, or Jenkins.
• Proficiency administering Apache Spark, Apache Airflow, Kafka, and Hadoop.
• Familiarity with modern data stack tools such as Snowflake, Cloudera, or DataIKU.
• Bachelor’s degree in Computer Science, Information Technology, or a related field (or equivalent practical experience).

Preferred Skills

• Experience creating developer-friendly platforms and establishing operational guardrails.
• Proven ability to mentor junior engineers and collaborate across Data Engineering and Compliance teams.

Key Skills

Education

Bachelor's degree