Description

Own test design and automated regression for AI/ML systems, ensuring model accuracy and data integrity.

This role is on-site.

Responsibilities

• Design and execute manual, functional, regression, UAT, and non-functional test cases for AI/ML and data systems.
• Build and maintain automated test suites using Selenium, pytest, and Python.
• Perform REST API testing and SQL-based data validation across ETL/ELT pipelines.
• Design and maintain LLM evaluation harnesses measuring hallucination, faithfulness, and output accuracy.
• Integrate tests into CI/CD pipelines (GitHub Actions, GitLab) and conduct root cause analysis.

Required Skills

• 5+ years of hands-on QA engineering experience.
• Strong proficiency in Python, Selenium, and pytest.
• Experience with CI/CD tools, specifically GitHub Actions and GitLab.
• Proficiency in SQL and data validation for ETL/ELT pipelines.
• Experience with REST API testing and performance/latency testing.
• Experience with LLM evaluation metrics (hallucination, faithfulness).
• Bachelor's degree in a relevant field.

Preferred Skills

• Previous experience in AI/ML quality assurance.
• Familiarity with Jira for defect tracking.

Key Skills

Education

Bachelor's degree