Description

You will design, implement, and execute comprehensive testing strategies for AI-powered solutions.

Responsibilities

• Design and implement test strategies for multi-component AI pipelines, RAG, and custom AI agents.
• Develop automated testing frameworks to assess AI model performance, accuracy, and production reliability.
• Create test cases focusing on model validation, output quality, and edge cases for AI/ML systems.
• Validate AI model integrations with production software via APIs and data pipelines.
• Mentor junior QA engineers and drive technical discussions on AI testing practices.

Required Skills

• 5+ years in software quality assurance and test automation, with 2+ years focused on AI/ML systems.
• 70% automation/development experience, 30% manual testing experience.
• Proficiency in Python and Java for test automation development.
• Experience with test automation tools: Selenium, Pytest, JUnit.
• Strong understanding of ML principles, evaluation metrics, and AI system testing.
• Knowledge of MLOps/LLMOps and the AI software lifecycle.
• Experience testing AI model integrations using APIs and data pipelines.
• Knowledge of SQL and Oracle for database testing.
• Experience with cloud platforms (AWS, Azure, GCP) and Docker/Kubernetes.

Key Skills

Education

Any Graduate