You will ensure data integrity and accuracy across Azure-based data platforms.
Responsibilities
- Execute ETL testing to validate data movement and transformation logic.
- Write and run complex database queries to identify data discrepancies.
- Validate data pipelines within Azure Data Factory and Databricks environments.
- Collaborate on data quality frameworks using Python and PySpark.
Required Skills
- 7+ years of experience in data quality or ETL testing roles.
- Strong proficiency in SQL and writing complex database queries.
- Deep understanding of Data Warehouse (DW) concepts.
- Hands-on experience with Python and PySpark.
- Experience working within Azure Cloud environments.
- Practical knowledge of Azure Data Factory and Azure Databricks.
- Exposure to DevOps practices.
Preferred Skills