Description

You will manage and upgrade data infrastructure and deployment pipelines on AWS, specifically focusing on Spark and AbInitio environments.

This role is on-site.

Responsibilities

• Develop and upgrade Spark infrastructure scripts (EAC) to support blue/green deployments on AWS Dev environments.
• Build and upgrade Jules pipelines for the deployment of Spark and AbInitio jobs.
• Execute Jules pipelines to deploy Spark and AbInitio scripts to AWS Dev environments.
• Manage blue/green deployment pipelines for both Spark and AbInitio scripts.
• Maintain AbInitio infrastructure scripts (EAC) within AWS Dev environments.

Required Skills

• 5+ years of professional experience.
• Hands-on experience with Spark.
• Experience with AbInitio.
• Proficiency with AWS environments.
• Experience with Jules pipeline execution and deployment.
• Experience managing blue/green deployment strategies.
• Bachelor's degree or equivalent graduate qualification.

Preferred Skills

• Experience with Terraform.

Key Skills

Education

Any Graduate