Description

Key Responsibilities

• Design and execute comprehensive test strategies for AI/ML-based applications and intelligent systems
• Validate AI model performance, accuracy, fairness, robustness, and reliability
• Develop automated testing frameworks for web, mobile, APIs, and AI-powered applications
• Create and execute test cases for model inference, prompt testing, hallucination detection, and response validation
• Perform functional, integration, regression, performance, and security testing
• Validate training datasets, model outputs, and data pipelines
• Collaborate with Data Scientists, AI Engineers, Product Managers, and Developers
• Monitor AI system behavior in production and identify quality improvement opportunities
• Define quality metrics, KPIs, and dashboards for AI solution performance
• Support CI/CD and continuous testing within DevOps pipelines

Required Skills

• QA & Testing: Quality Engineering, Test Strategy, Manual & Automated Testing, Functional, Regression, API, Performance & Security Testing, Defect Management
• AI/ML Testing: Model Validation, Prompt Testing, Hallucination Detection, Bias & Fairness Testing, Data Quality Testing, AI Performance Monitoring
• Automation Tools: Selenium, Playwright, Cypress, Postman, Rest Assured, JMeter
• Programming: Python, Java, JavaScript/TypeScript
• Cloud & DevOps: Azure, AWS, GCP, GitHub Actions, Azure DevOps, Jenkins, CI/CD Pipelines

Preferred Skills

• Retail domain experience (required)
• Strong understanding of STLC and SDLC

Key Skills

Education

Bachelor's degree