Description
You will own the quality assurance strategy and execution for AI/ML components within a GCP environment.
Responsibilities
- Develop and execute test plans and automated frameworks for AI/ML components, including models, pipelines, APIs, and agent workflows.
- Define QA strategies covering AI output correctness, stability, bias detection, and edge case resilience.
- Test AI model integrations with Vertex AI Endpoints and ADK agent systems alongside cloud services.
- Implement regression, performance, and load testing for multi-agent and conversational systems.
- Integrate automated QA checkpoints into MLOps pipelines as part of CI/CD processes.
Required Skills
- Bachelor's degree in Computer Science, Software Engineering, ML/AI, or related fields.
- 5-8+ years of QA experience with strong exposure to AI/ML testing concepts.
- Solid programming skills in Python for test automation tooling and ML model test harnesses.
- Understanding of Google Cloud services, specifically Vertex AI and related AI/ML services.
- Experience with automated testing systems and CI/CD integrations.
- Experience with APIs.
- Familiarity with GCP.
Preferred Skills
- Experience with Google Agent Development Kit (ADK) or other agent frameworks.
- Exposure to RAG systems, conversational AI evaluation, and context/semantics QA.