Description
You will test AI applications, focusing on Agentic AI, Generative AI, and responsible AI principles.
This role is remote.
Responsibilities
- Validate Agentic AI agents and Generative AI model outputs, including prompt engineering evaluation.
- Test for fairness, bias, explainability, privacy, and security in AI systems.
- Execute functional, integration, and performance tests using Agile, BDD, and DevOps methodologies.
- Manage test automation, defect reporting, triage, and QA metrics using tools like Jira and Azure DevOps.
- Conduct User Acceptance Testing (UAT) and collaborate within DevSecOps pipelines.
Required Skills
- 5+ years as a QA Engineer with significant experience testing AI/ML products.
- Strong knowledge of test automation tools: Tosca, Python, Selenium.
- Proficiency in C# and Java for test development.
- Experience with test management tools: Atlassian Jira, Azure DevOps.
- Understanding of Responsible AI principles, including bias detection and security.
- Knowledge of Generative AI solutions and Agentic AI architectures.
- Familiarity with DevOps pipelines, release processes, and change management.
- ISTQB Foundation Level certificate or equivalent experience.
Preferred Skills
- Experience with BDD frameworks and Waterfall methodologies.
- Strong written and verbal communication skills for cross-functional collaboration.