Description
You will validate data integrity and automate testing for end-to-end data pipelines.
Responsibilities
- Validate data integrity and accuracy during migrations and pipeline workflows.
- Automate ETL testing processes to verify end-to-end data flow.
- Automate AWS workflows to support scalability and performance optimization.
- Implement CI/CD practices for continuous testing and deployment of data pipelines.
- Develop testing frameworks to support data regression testing.
- Write complex SQL queries for debugging and data retrieval.
Required Skills
- 5+ years of experience in ETL testing and data pipelines.
- Proficiency in Python and SQL.
- Hands-on experience with AWS.
- Strong background in automation testing and test case development.
- Experience with database testing and data migration.
- Knowledge of DevOps practices.
- Experience with API testing and testing frameworks.
- Familiarity with Docker and Kubernetes.
- Any Graduate degree.