Description

You will ensure the quality and integrity of data products through rigorous testing and validation of data workflows.

Responsibilities

• Design and manage AWS testing environments for data workflows during development and deployment.
• Develop complex SQL scripts and dashboards to summarize data quality analysis and monitor data health.
• Execute functional, regression, system, integration, and end-to-end testing for cloud and on-prem ETL processes.
• Validate source-to-destination data movement and transformation across various database applications.
• Troubleshoot and resolve data issues, anomalies, and inconsistencies in integration services.

Required Skills

• 5+ years of experience in data quality engineering or SDET roles.
• Extensive experience with SQL, Unix, and Linux scripting.
• Deep expertise in data migration, specifically moving data from Teradata to Redshift.
• Hands-on experience testing Cloud and On-Prem ETL tools such as Informatica, SSIS, or Ab Initio.
• Proficiency with AWS services including Athena, EMR, Redshift, S3, and EC2.
• Strong command of Python scripting and programming tools like MapReduce.
• Experience with DBMS platforms including Oracle, Teradata, SQL Server, DB2, Redshift, Postgres, and Sybase.
• Experience with DevOps/DataOps practices, including Jenkins, GitLab, and CI/CD pipelines.
• Knowledge of data modeling, data warehousing, and data architecture best practices.

Preferred Skills

• Experience with API automation using Rest Assured, Java, or Cypress.
• Familiarity with data science platforms like SageMaker or H2O.

Key Skills

Education

Any Graduate