Description

You will design and implement large-scale, multi-region cloud data lake solutions on AWS, focusing on streaming and event-driven logging. You will own the architecture for connectivity, security, and compute services, ensuring robust infrastructure through Infrastructure as Code.

Responsibilities

• Architect and deploy multi-region data lake solutions using AWS services including S3, Glue, MSK, EC2, Lambda, and KMS.
• Design secure network connectivity and transit gateways, managing VPCs and IAM policies for strict access control.
• Implement Infrastructure as Code using Terraform to automate the provisioning and management of all cloud resources.
• Define and maintain containerized workloads using Amazon EKS and ECS, ensuring high availability and scalability.
• Develop and optimize data processing pipelines using Python and SQL, leveraging serverless functions for event-driven tasks.

Required Skills

• 12+ years of experience designing and implementing large-scale cloud data solutions.
• Expert-level proficiency with AWS services: S3, Glue, MSK, EC2, Lambda, KMS, IAM, CloudWatch, VPC, and Transit Gateway.
• Advanced experience with AWS container services, specifically EKS and ECS.
• Strong proficiency in Infrastructure as Code, specifically Terraform.
• Proficient in Python and SQL for data processing and automation.
• Experience with serverless cloud programming and event-driven architectures.
• Any Graduate degree.

Key Skills

Education

Any Graduate