Description

You will own data quality and validation for large-scale migration and transformation projects.

Responsibilities

• Execute data migration testing, moving data from Teradata to Redshift.
• Validate ETL processes across Cloud and On-Prem environments using Informatica, Ab Initio, or Glue.
• Develop and maintain automation frameworks for API, REST, and UI testing.
• Build and manage CI/CD pipelines within DevOps and DataOps workflows.
• Perform complex data validation across Data Warehouses, Data Lakes, and Big Data environments.

Required Skills

• 8+ years of experience in data quality and testing.
• Expertise in SQL and hands-on experience with complex queries.
• Extensive experience with DBMS including Oracle, Teradata, SQL Server, DB2, Redshift, Postgres, and Sybase.
• Proficiency in Python scripting and Unix/Linux scripting.
• Deep knowledge of AWS services including Athena, EMR, Redshift, Glue, Kinesis, Kafka (MSK), and SageMaker.
• Experience with NoSQL and unstructured data such as MongoDB, Cassandra, Redis, and ZooKeeper.
• Hands-on experience with MapReduce tools including Hadoop, Hive, Pig, and Kafka.
• Technical proficiency in Java, JavaScript, and API testing using RestAssured or SoapUI.
• Experience with automation tools including Selenium, BDD/Cucumber, SpecFlow, and Cypress.

Preferred Skills

• Experience with large-scale, multi-year data transformation projects.

Key Skills

Education

Any Graduate