Description

You will design, build, and own the technical direction of cloud-based big data pipelines and infrastructure.

This role is remote.

Responsibilities

• Architect and build cloud-based big data pipelines and data processing workflows.
• Manage deployment pipelines, CI/CD processes, and release ownership for critical infrastructure.
• Lead scrum team initiatives and provide technical direction.
• Support the production stack and collaborate with SRE teams.

Required Skills

• 10+ years of overall IT experience.
• 3+ years of experience with Scala.
• 3+ years of experience with Python.
• 5+ years of experience with AWS services (S3, EMR, SNS/SQS, EventBridge, Lambda, CloudWatch, MSK, Glue, containers).
• Experience with Spark, Spark Streaming, and Hadoop.
• 3+ years in Architecture and Design of cloud-based big data pipelines.
• 2+ years of experience with Infrastructure as Code, specifically Terraform.
• Experience with SQL, Shell scripting, and orchestration via Airflow or MWAA.
• Experience with Git, CI/CD, and DevOps practices.

Preferred Skills

• Azure experience.
• Big Data and/or Cloud certifications.

Key Skills

Education

Any Graduate