Description

You will design, build, and maintain ETL/ELT pipelines that integrate data from Amazon S3, RDS, and external APIs into Redshift. You will own the orchestration of these workflows using AWS Step Functions or Amazon MWAA.

This role is on-site.

Responsibilities

• Develop and maintain ETL pipelines for data ingestion from diverse sources.
• Write Redshift Stored Procedures using PL/pgSQL to encapsulate logic and ensure atomic transactions.
• Automate data workflows using AWS Step Functions or Amazon MWAA (Airflow).
• Optimize Redshift query performance via distribution styles, sort keys, and compression strategies.
• Troubleshoot, support, and document ETL workflows, including data mapping and transformation rules.

Required Skills

• 5+ years of experience in pipeline development and data engineering.
• Strong proficiency in Python or UNIX shell scripting for automation.
• Deep knowledge of AWS Redshift, including stored procedures and performance tuning.
• Hands-on experience with Amazon S3 and Amazon RDS.
• Proficiency in Unix/Linux environments.
• Experience with AWS services for orchestration (Step Functions or MWAA).
• Bachelor’s degree in a related field or equivalent progressive experience.

Preferred Skills

• Experience with ELT patterns and data transformation logic.

Key Skills

Education

Bachelor's degree