Description

Architect and maintain scalable data pipelines from Workday to AWS Redshift, owning the end-to-end data lifecycle.

This role is remote.

Responsibilities

• Design and implement Airflow workflows to automate data processing.
• Optimize Redshift performance through query tuning and structural improvements.
• Perform data profiling to troubleshoot and resolve data quality issues.
• Maintain documented code repositories and configurations using Git and Bitbucket.

Required Skills

• 10+ years of data engineering experience.
• Advanced experience designing AWS data lake solutions.
• Hands-on integration of Redshift with DMS, Glue, Lambda, S3, and Athena.
• Proficiency in Python for developing Airflow DAGs and operators.
• Experience with PySpark and Glue ETL scripting, including data frame transformations and joins.
• Competency in deploying AWS infrastructure via CloudFormation and YAML-defined IAM policies.
• Ability to debug serverless applications using CloudWatch Logs, Log Insights, and CloudTrail.

Preferred Skills

• Experience converting Oracle scripts and stored procedures to Redshift equivalents.
• Proficiency in SQL programming and Redshift stored procedures.

Key Skills

Education

Any Graduate