Description

You will design and execute testing strategies for AI-powered solutions, including RAG systems and custom agents.

This role is hybrid.

Responsibilities

• Design test strategies for multi-component AI pipelines and model integrations.
• Develop automated frameworks to assess AI model performance, accuracy, and production reliability.
• Create test cases for model validation, output quality, and edge cases in AI/ML systems.
• Validate AI integrations with production software via APIs and data pipelines.
• Mentor junior QA engineers and drive technical discussions on AI testing practices.

Required Skills

• 5+ years in software quality assurance and test automation, with 2+ years focused on AI/ML.
• 70% automation/development experience, 30% manual testing experience.
• Proficiency in Python and Java for test automation development.
• Experience with Selenium, Pytest, and JUnit.
• Strong understanding of ML principles, evaluation metrics, and AI system testing.
• Knowledge of MLOps/LLMOps and the AI software lifecycle.
• Experience testing AI model integrations using APIs and data pipelines.
• Knowledge of SQL and Oracle for database testing.
• Experience with cloud platforms (AWS, Azure, GCP) and Docker/Kubernetes.

Key Skills

Education

Any Graduate