Description

You will architect and maintain fault-tolerant data infrastructure and CI/CD pipelines on AWS.

This role is remote.

Responsibilities

• Architect and implement data pipelines using AWS Glue, Lambda, EMR, Step Functions, and Redshift.
• Build and optimize data lakes and warehouses on Amazon S3, Redshift, and Athena.
• Develop Python-based ETL/ELT frameworks and reusable data transformation modules.
• Integrate multiple data sources including RDBMS, APIs, Kafka/Kinesis, and SaaS systems.
• Implement CI/CD pipelines for data workflows using AWS CodePipeline, GitHub Actions, or Cloud Build.

Required Skills

• 11+ years of professional experience in data engineering or DevOps.
• Expertise in AWS services: Glue, Lambda, EMR, Step Functions, S3, Redshift.
• Strong proficiency in Python for ETL/ELT development.
• Experience integrating data from RDBMS, APIs, and Kafka.
• Familiarity with Data Science and Analytics workflows.
• Experience with DevOps practices and CI/CD implementation.
• Knowledge of data modeling, schema design, and partitioning strategies.
• Experience with GitHub Actions.

Key Skills

Education

Bachelor's degree