Design and manage scalable data pipelines within an AWS environment.
Responsibilities
- Build and maintain AWS ETL pipelines to support data workflows.
- Configure IAM roles and manage cloud data migrations using AWS DMS and Cross Account Replication.
- Implement data ingestion and design patterns to ensure data quality and reliability.
- Deploy infrastructure using AWS CDK to automate data environments.
Required Skills
- 5+ years of professional experience in data engineering roles.
- 4+ years of experience developing and maintaining AWS ETL pipelines.
- Hands-on expertise with AWS services including S3, Lambda, Step Functions, AWS Glue, and IAM.
- Strong proficiency in Python.
- Experience with AWS CDK for infrastructure as code.
- Experience with cloud data migration tools such as AWS DMS.
- Any graduate degree.
Preferred Skills
- Experience with Data Lake Formations.