Description

You will focus on ensuring data accuracy and integrity within data pipelines.

Responsibilities

• Develop and execute data quality validation and transformation tests using Databricks and SQL Server.
• Perform data profiling, anomaly detection, and root cause analysis on production data.
• Define and measure concrete data quality metrics and maintain detailed documentation.
• Build and maintain test automation for data quality processes.

Required Skills

• 5+ years of experience in Data Quality Engineering or Data Testing.
• Strong proficiency in Python and SQL for data quality scripting and automation.
• Hands-on experience with Databricks and SQL Server testing.
• Experience with data validation frameworks (e.g., Collibra, Great Expectations).
• Familiarity with healthcare data standards (HL7, FHIR, HIPAA).
• Experience with test automation and data quality process development.
• Exposure to cloud environments including Azure, AWS, or GCP.
• Understanding of CI/CD integration for data testing pipelines.

Key Skills

Education

Any Gradute