Description
You will build and manage scalable ETL pipelines and lead large-scale cloud migration efforts within an AWS environment.
Responsibilities
- Develop and maintain scalable ETL pipelines within the AWS ecosystem.
- Conduct ETL testing to ensure data integrity, accuracy, and performance.
- Lead and support large-scale cloud migration efforts and data transitions.
- Use Python to develop custom scripts and automate data processes.
- Monitor, troubleshoot, and optimize data workflows for reliability.
Required Skills
- 5-10+ years of experience in Data Engineering.
- Hands-on experience with AWS services including S3, Redshift, Glue, and Lambda.
- Advanced Python skills for data processing and automation.
- Expertise in ETL methodologies and testing.
- Proven experience with cloud migration strategies and best practices.
- Strong proficiency in data processing and ETL pipeline development.
- Ability to troubleshoot and resolve complex data issues.