Description

What's the Job?

• Design, automate, and execute testing strategies for AI-powered applications, machine learning systems, AI agents, copilots, and generative AI solutions.
• Validate AI model outputs for accuracy, consistency, reliability, and safety through functional, integration, end-to-end, regression, and performance testing.
• Build automated evaluation pipelines for AI responses and workflows, integrating AI testing into CI/CD to detect quality issues early.
• Test AI guardrails, business rules, permissions, and governance controls, including adversarial, negative, and edge-case scenarios to uncover failures and hallucinations.
• Partner across engineering and product teams to provide quality feedback during design reviews and support production readiness and defect triage.

What's Needed?

• 3–6 years of software testing, QA automation, or quality engineering experience, with 1–3 years of exposure to AI/ML or Generative AI technologies.
• Experience developing automated test solutions using Python, Java, JavaScript/TypeScript, or C#.
• Strong understanding of test automation, SDLC, Agile methodologies, and CI/CD pipelines.
• Experience with API testing and automation tools, plus testing distributed systems, web applications, and APIs.
• Ability to independently own AI testing and automation efforts while collaborating closely with AI developers, architects, and product teams

Key Skills

Education

Any Graduate