Description

Key Skills: Python, AI/ML Model Validation, GenAI, LLM Evaluation, LangChain, Quantitative Analysis, Model Risk Governance, Performance Metrics

Roles & Responsibilities:

• Validate and govern AI/GenAI/LLM models using defined evaluation criteria.
• Measure model performance using quantitative metrics and document results.
• Identify risks, failure modes, and define control mechanisms for LLM systems.
• Maintain evaluation artifacts, version control, and audit-ready documentation.
• Collaborate with AI engineering teams to improve model reliability and coverage.
• Support model risk governance and compliance processes.

Experience Required:

• 4-8 years of experience in quantitative analytics, AI/ML, or model validation.
• Strong Python programming skills for evaluation workflows.
• Hands-on experience with GenAI and LLM evaluation techniques.
• Understanding of model risk, governance, and control frameworks.
• Exposure to LangChain is preferred.
• Strong analytical and problem-solving skills.

Education: Any Post Graduation

Key Skills

Education

Any Graduate