Description

You will lead the design and maintenance of scalable data pipelines and infrastructure on AWS.

This role is on-site.

Responsibilities

• Design and maintain scalable data pipelines using AWS Glue, Lambda, Step Functions, S3, Redshift, EMR, and Data Pipeline.
• Develop Python scripts for data ingestion, transformation, and automation.
• Write and optimize complex SQL queries for ETL and analytics workflows.
• Implement monitoring, logging, and alerting to ensure pipeline reliability and performance.
• Apply DevOps practices using GitHub, Terraform, and CloudFormation for infrastructure automation and CI/CD.

Required Skills

• 5+ years of experience in data engineering or a similar role.
• Strong hands-on experience with AWS data services including EMR, Glue, Lambda, Step Functions, S3, and Redshift.
• Advanced proficiency in Python for scripting and automation.
• Solid experience with Unix/Linux shell scripting and system-level data operations.
• Strong command of SQL and relational databases.
• Experience with Terraform and/or AWS CloudFormation for infrastructure-as-code.
• Proficiency with GitHub for version control.
• Experience working in Agile/Scrum environments.

Preferred Skills

• AWS Certification such as AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect.

Key Skills

Education

Bachelor's or Master's degrees