Description
You will ensure the quality and reliability of ETL processes and data integration workflows.
Responsibilities
- Design and implement automated tests to validate data transformation and migration.
- Collaborate with data engineers and developers to identify and resolve data quality issues.
- Develop automation frameworks and test cases to enhance data pipeline integrity.
- Provide testing oversight within an Agile team environment.
Required Skills
- 8+ years of IT experience.
- 5+ years of experience in ETL testing and automation framework development.
- Proficiency in Python or PySpark for scripting and automation.
- Strong SQL skills for data validation.
- Experience handling big data using ETL tools such as Informatica.
- Hands-on experience testing in AWS environments, specifically AWS S3 and Redshift.
- Experience working within a Big Data ecosystem and data lakehouse architectures.
- Practical knowledge of Test Automation and DevOps practices in ETL and Cloud contexts.
Preferred Skills
- Experience with Kafka and Shell scripting.
- Familiarity with DBT (Data Build Tool) or similar transformation tools.
- Healthcare domain experience.