Description

Job Description

• Strong understanding of GenAI system architecture (RAG / Agents) • Implement python-based AI Evaluation frameworks like Ragas, DeepEval, etc • Perform Model & Agent quality evaluation using tools like Arize, LangFuse, ConfidentAI, etc • Perform Responsible AI validation & report RAI metrics • Golden dataset curation & Synthetic dataset generation • Ability to instrument & establish AI Observability / Tracing using OTEL libraries Expert in Python

Required Skills

• DeepEval
• GenAI system architecture-Agents
• GenAI system architecture-RAG
• Golden dataset curation and Synthetic dataset generation
• LangFuse
• Model and Agent quality evaluation
• OTEL libraries
• Python
• Ragas
• Responsible AI validation and report RAI metrics

Key Skills

Education

Any Graduate