Description

You will design, build, and maintain scalable ETL pipelines using AWS Glue, PySpark, and AWS Lambda. You will migrate structured and semi-structured data from S3 and Hadoop to Amazon Redshift.

This role is on-site.

Responsibilities

• Design and develop ETL pipelines for data processing and migration.
• Optimize data ingestion and transformation for performance and cost-efficiency.
• Implement data validation, cleansing, and transformation logic to ensure integrity.
• Monitor pipelines, troubleshoot issues, and ensure minimal downtime.
• Document data flows, architecture, and governance standards.

Required Skills

• 5+ years of experience in AWS data engineering.
• Proficiency in AWS Glue, AWS Lambda, S3, and Redshift.
• Strong experience with PySpark and Hadoop.
• Proven track record in data migration and ETL development.
• Ability to collaborate with data architects and stakeholders.
• Knowledge of data security, compliance, and governance.
• Any Graduate degree.

Preferred Skills

• Experience with AI Code Assist Tools.
• Strong communication skills for cross-functional collaboration.

Key Skills

Education

Any Graduate