Description

You will lead the migration of data from on-premise Hadoop environments to AWS, focusing on Amazon Redshift.

Responsibilities

• Lead end-to-end data migration from on-prem Hadoop to Amazon Redshift.
• Design, build, and manage scalable ETL/ELT pipelines for cloud environments.
• Implement performance tuning, optimization, and maintenance for Amazon Redshift.
• Develop automated data workflows using AWS-native services including S3, Glue, EMR, and Lambda.
• Ensure data integrity, security, and compliance throughout the migration process.

Required Skills

• 5+ years of experience in data engineering roles.
• Expertise in Amazon Redshift design, workload management, and query optimization.
• Proven experience migrating data from on-prem Hadoop to AWS.
• Proficiency in SQL and Python.
• Hands-on experience with AWS S3, Glue, Lambda, EMR, and EC2.
• Strong understanding of ETL/ELT processes and pipeline orchestration.
• Knowledge of AWS data security practices including IAM and encryption.
• Bachelor’s or Master’s degree in Computer Science or a related field.

Preferred Skills

• AWS Certifications (Solutions Architect, Big Data Specialty, or Database Specialty).
• Experience with Docker, Kubernetes, and Agile/Scrum environments.

Key Skills

Education

Bachelor’s or Master’s degree in Computer Science