Description

Key Skills: AI Agents, Ab Testing

Roles and Responsibilities:

• Design and execute performance test strategies for AI agent workflows and enterprise GenAI platforms.
• Validate agent behavior across multi-step interactions, tool usage, and response quality under load.
• Measure model and system outcomes using accuracy, hallucination, latency, and reliability metrics.
• Partner with architecture and platform teams to assess AI solution readiness on GCP and Vertex AI.
• Analyze test results, identify bottlenecks, and provide actionable recommendations for platform improvement.

Skills Required:

• 7+ years of relevant experience in performance testing, AI platform validation, or enterprise AI solution architecture.
• Strong hands-on experience in performance testing for AI platforms and agent-based systems.
• Deep working knowledge of AI Agents, Agentic AI, CrewAI, LangGraph, AutoGen, and Semantic Kernel.
• Experience with Generative AI, LLMs, GPT, Claude, Gemini, and RAG-based solutions.
• Practical exposure to Google Cloud Platform, especially Vertex AI, with Python-based validation or test automation.

Good to Have:

• A/B Testing, MLOps, LLMOps, Kubernetes, Docker, Data Science, Analytics, AI Governance, Responsible AI, German language skills.

Education: Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field

Key Skills

Education

Any Graduate