Description

You will design, implement, and execute comprehensive testing strategies for AI-powered solutions.

Responsibilities

• Design and implement test strategies for multi-component AI systems, including RAG and custom AI agents.
• Develop automated testing frameworks to validate AI model performance, accuracy, and reliability in production.
• Create test cases for AI/ML systems, focusing on model validation, output quality, and edge cases.
• Contribute to MLOps and LLMOps practices, focusing on continuous testing and monitoring.
• Translate functional requirements into detailed test specifications and automation strategies.

Required Skills

• Bachelor's degree in Computer Science or equivalent experience.
• 3+ years in software quality assurance and test automation.
• At least 2 years focused on testing AI/ML systems.
• 70% automation/development experience, 30% manual testing experience.
• Proficiency in Python and Java with strong coding skills for test automation.
• Experience with test automation tools like Selenium, Pytest, and JUnit.
• Strong understanding of machine learning principles and AI system testing methodologies.
• Experience testing AI model integrations using APIs and data pipelines.
• Knowledge of MLOps/LLMOps and the end-to-end lifecycle of AI-powered software.
• Good knowledge of relational databases (SQL, Oracle) and complex SQL scripting.
• Experience with cloud platforms such as AWS, Azure, or GCP.

Key Skills

Education

Any Graduate