Description

You will own the deployment, infrastructure, and operational reliability of ingestion and ETL pipelines. Your work bridges pipeline development and production-grade operations, ensuring zero-downtime updates and efficient autoscaling.

Responsibilities

• Build and maintain CI/CD pipelines for automated testing and deployment of ingestion and ETL workloads across dev, staging, and production environments.
• Implement infrastructure-as-code using Terraform, CloudFormation, or CDK to provision cloud resources for pipeline operations.
• Configure secrets management, cross-account IAM patterns, and VPC connectivity for secure source system integration.
• Develop autoscaling patterns for compute resources to handle variable data volumes while enforcing cost controls.
• Collaborate with platform and security teams to manage approvals, quotas, and environment configurations aligned with CI/CD guidelines.

Required Skills

• 5–7 years of experience in DevOps, platform engineering, or SRE with a focus on data platforms.
• Expert-level AWS experience including IAM, VPC, CodePipeline, CodeBuild, ECS/EKS, S3, and KMS.
• Proficiency in infrastructure-as-code, specifically Terraform (preferred) or CloudFormation/CDK.
• Strong experience building CI/CD pipelines for data workloads rather than standard application deployments.
• Hands-on knowledge of container orchestration (ECS, EKS) and serverless compute (Lambda, Glue).
• Scripting proficiency in Bash and Python.
• Familiarity with monitoring tools such as CloudWatch and Grafana for alerting configuration.
• Experience working in regulated or security-conscious environments.

Preferred Skills

• AWS certifications (Solutions Architect or DevOps Engineer).
• Experience with GitOps workflows (ArgoCD, Flux) or FinOps practices.

Key Skills

Education

Any Graduate