Description

You will own automated ETL testing and framework development within AWS environments. You build automation infrastructure, execute data validations, and manage job scheduling. You implement CI/CD pipelines and reliability engineering practices to ensure data integrity across complex data models.

Responsibilities

• Build automation testing frameworks from scratch using Python and AWS services.
• Execute data validations, comparisons, and job loads to ensure accuracy.
• Manage automated job executions and dependencies using Autosys.
• Implement CI/CD pipelines and Reliability Engineering (SRE) standards.
• Perform complex data comparisons across tables using SQL and Unix shell scripting.

Required Skills

• 8-10 years of overall testing experience.
• 5+ years of experience in ETL automated testing.
• Hands-on experience with Python for automation testing.
• Experience with AWS services: Lambda, RDS, Redshift, EC2, and EMR.
• Strong SQL skills for data validation and joins.
• Proficiency in Unix shell scripting.
• Deep understanding of ETL concepts: 3NF, dimensional models, fact loads, and surrogate keys.
• Experience with Autosys job execution.
• Knowledge of CI/CD and Reliability Engineering.

Key Skills

Education

Any Graduate