Description

You will own QA automation for data engineering, ETL, and large-scale data pipelines.

This role is on-site.

Responsibilities

• Automate testing for data engineering and ETL processes using Python.
• Validate large-scale data pipelines within Azure Databricks or Snowflake environments.
• Perform data validation and complex querying using SQL.
• Verify streaming data pipelines using Azure Event Hub or Kafka.
• Analyze test results and pipeline performance using Azure Monitor and Log Analytics.

Required Skills

• 5+ years of experience in QA automation for data engineering or ETL domains.
• Strong expertise in Python for test automation using PyTest or unittest.
• Proficiency in SQL for data validation and querying.
• Hands-on experience with Azure Data Cloud services including ADF, Synapse, ADLS Gen 2, and Cosmos DB.
• Experience with data testing frameworks such as Great Expectations.
• Knowledge of modern data Lakehouse formats like Delta Table and Parquet.
• Understanding of data modeling concepts including Star Schema, Data Vault, and Medallion Architecture.

Preferred Skills

• Direct experience with Azure Databricks.

Key Skills

Education

Any Graduate