Description

Own the design and implementation of the enterprise Data Lake House solution on AWS.

This role is hybrid.

Responsibilities

• Architect and build scalable data lake infrastructure using AWS Lake Formation, S3, and Glue.
• Develop serverless data processing pipelines with AWS Lambda, Step Functions, and Pyspark.
• Manage infrastructure as code using Terraform, CloudFormation, and Stacker.
• Implement CI/CD workflows and DevOps practices using GitLab.
• Ensure data governance and security through IAM policies and DynamoDB integration.

Required Skills

• 10+ years of software engineering experience with at least 5 years in cloud data engineering.
• Deep expertise in AWS services: Lake Formation, S3, Glue (Crawler, Catalog, Registry, Jobs), DynamoDB, IAM, Lambda, and Step Functions.
• Proficiency in Python and Pyspark for data processing.
• Strong experience with Infrastructure as Code tools: Terraform, CloudFormation, and Stacker.
• Hands-on experience with DevOps tools, specifically GitLab for CI/CD.
• Experience with serverless architecture patterns.

Preferred Skills

• Experience refactoring legacy data systems into modern cloud-native architectures.
• Familiarity with Agile principles in a DevOps context.

Key Skills

Education

Any Graduate