Description

You will own the quality assurance strategy and execution for AI/ML components within a GCP environment.

Responsibilities

• Develop and execute test plans and automated frameworks for AI/ML components, including models, pipelines, APIs, and agent workflows.
• Define QA strategies covering AI output correctness, stability, bias detection, and edge case resilience.
• Test AI model integrations with Vertex AI Endpoints and ADK agent systems alongside cloud services.
• Implement regression, performance, and load testing for multi-agent and conversational systems.
• Integrate automated QA checkpoints into MLOps pipelines as part of CI/CD processes.

Required Skills

• Bachelor's degree in Computer Science, Software Engineering, ML/AI, or related fields.
• 5-8+ years of QA experience with strong exposure to AI/ML testing concepts.
• Solid programming skills in Python for test automation tooling and ML model test harnesses.
• Understanding of Google Cloud services, specifically Vertex AI and related AI/ML services.
• Experience with automated testing systems and CI/CD integrations.
• Experience with APIs.
• Familiarity with GCP.

Preferred Skills

• Experience with Google Agent Development Kit (ADK) or other agent frameworks.
• Exposure to RAG systems, conversational AI evaluation, and context/semantics QA.

Key Skills

Education

Bachelor's degree