Description

Define and execute quality standards for generative AI solutions, ensuring alignment with business and compliance requirements. Design test strategies to validate AI outputs for accuracy, consistency, and usability. Automate testing frameworks to handle large-scale validation of AI models and workflows. Monitor model performance and drift, resolving risks and anomalies proactively. Champion responsible AI practices by validating fairness and bias mitigation.

Responsibilities

• Define quality standards for generative AI solutions.
• Design and execute test strategies for AI outputs.
• Automate testing frameworks for large-scale validation.
• Monitor performance and drift in AI models.
• Document test results and insights for stakeholders.

Required Skills

• GenAI experience with AI/ML Testing Frameworks.
• Automation for AI QA and Model Validation & Benchmarking.
• Data Quality Assurance and Performance & Reliability Testing.
• Strong stakeholder communication and documentation skills.
• Agile/DevOps practices and risk management.
• Ethical and responsible AI awareness.
• Bachelor's degree in Computer Science, Engineering, or related field.
• 5+ years of proven experience in QA roles with a focus on AI solutions.

Preferred Skills

• Domain knowledge in Wealth Management or Insurance.

Key Skills

Education

Bachelor's degree