Description

You will build and maintain configuration-driven data ingestion and transformation pipelines on AWS. You own the CI/CD automation, testing frameworks, and monitoring dashboards for data products.

This role is on-site.

Responsibilities

• Develop ingestion and transformation pipelines using AWS Glue, Lambda, and Redshift.
• Implement CI/CD pipelines for automated build, test, and deployment of data products.
• Establish automated test frameworks for schema validation, data quality, and performance testing.
• Set up monitoring and observability dashboards for product-level metrics using CloudWatch and custom metrics.
• Collaborate with data modelers and architects to ensure alignment with business requirements.

Required Skills

• 5+ years of experience in data engineering and pipeline development.
• Proficiency in Python, SQL, and shell scripting.
• Hands-on experience with AWS services: Glue, Redshift, S3, Lambda, CloudWatch.
• Experience with CI/CD tools: Terraform, Jenkins, AWS CodePipeline.
• Strong knowledge of ETL/ELT processes and frameworks.
• Bachelor’s degree in Computer Science, Data Engineering, or a related field.

Preferred Skills

• AWS Certified Data Analytics or AWS Certified Developer certification.

Key Skills

Education

Bachelor's degree