Description

You will validate and assure the quality of existing data pipelines.

This role is on-site.

Responsibilities

• Design, develop, and execute data quality test cases for ETL/ELT processes.
• Monitor and trigger data pipelines to ensure timely data delivery.
• Run and maintain data quality scripts to identify anomalies and integrity issues.
• Perform root cause analysis for data anomalies and pipeline failures.
• Document data quality standards, testing procedures, and validation results.

Required Skills

• 5+ years of experience in data quality assurance.
• Strong understanding of ETL/ELT processes, data warehousing, and data modeling.
• Proficiency in SQL for complex data validation and querying.
• Experience with Python or Shell scripting for automation.
• Hands-on experience with data pipeline orchestration tools like Apache Airflow.
• Familiarity with AWS or Azure data services.
• Knowledge of data formats including JSON, Parquet, and Avro.

Preferred Skills

• Experience with Spark, Hadoop, or Kafka.
• Knowledge of CI/CD practices for data pipelines.

Key Skills

Education

Any Gradute