Description

Validate and govern AI, GenAI, and LLM models using defined evaluation criteria, quantitative metrics, and risk control mechanisms.

This role is on-site.

Responsibilities

• Validate and govern AI/GenAI/LLM models using defined evaluation criteria.
• Measure model performance using quantitative metrics and document results.
• Identify risks, failure modes, and define control mechanisms for LLM systems.
• Maintain evaluation artifacts, version control, and audit-ready documentation.
• Collaborate with AI engineering teams to improve model reliability and coverage.

Required Skills

• 4-8 years of experience in quantitative analytics, AI/ML, or model validation.
• Strong Python programming skills for evaluation workflows.
• Hands-on experience with GenAI and LLM evaluation techniques.
• Understanding of model risk, governance, and control frameworks.
• Quantitative analysis and performance metrics.

Preferred Skills

• Exposure to LangChain.

Key Skills

Education

Any Graduate