Description

Ensure data integrity and quality across complex data pipelines by designing and executing validation tests for data flows and message schemas.

This role is on-site.

Responsibilities

• Design and execute tests validating data flows and message schemas across integrated systems.
• Validate producer-to-Kafka message flows using real-time data pipeline knowledge.
• Manage and test data using masking, sub-setting, and synthetic data generation techniques.
• Develop and maintain data quality checks within the data ecosystem.

Required Skills

• 6+ years in software development, QA, or data engineering delivery.
• 5+ years of hands-on experience with Test Data Management and advanced SQL.
• 3+ years of experience with Informatica IICS/IDMC.
• 2+ years working within the Azure data ecosystem.
• 2+ years working with Databricks (PySpark, Spark SQL, Delta Lake).
• 1+ year using Python with libraries like Pandas, NumPy, and Matplotlib.
• Strong knowledge of data masking, data sub-setting, and synthetic data generation.
• Experience with JSON and Avro message schemas.
• Proficiency with SQL Server, Oracle, DB2, Azure SQL, or equivalent databases.

Key Skills

Education

Any Gradute