Description

• Google Vertex AI / Gemini integration testing - can hit live endpoints, validate responses, handle auth/rate limits, parse structured outputs.
• LLM output validation - design test cases that detect regression in model behaviour (consistency, edge-case handling); script adversarial/prompt-injection tests against known threat patterns.
• Responsible for setting up any AI testing frameworks and automation needed.
• Develop, improve, and maintain automated test suites across frontend and backend components.
• Write high‑quality, maintainable automated tests that support rapid delivery and reliability.
• Identify and implement a test coverage tool to monitor coverage.
• Own the execution and reporting of automated test pipelines within CI/CD workflows.
• Monitor test flakiness and stability; proactively diagnose root causes and implement fixes.
• Contribute to discussions on testing strategy, tooling, and testability improvements across the product.
• Ensure all automated testing follows best practice, is version‑controlled, and integrates cleanly into engineering workflows.
• Design and implement E2E testing to simulate real user actions and validate the full workflow.

Collaboration & Ways of Working

• Work day‑to‑day with developers across three squads to embed quality into feature development.
• Participate in squad ceremonies (stand‑ups, refinement, planning), providing input on test impact and automation needs.
• Collaborate with product managers and engineering leads to understand feature requirements and identify test scenarios.
• Work within an agile, cloud‑first engineering environment and contribute to continuous improvement of testing processes.
• Document and track bugs encountered, providing detailed reproduction steps, environment details and visual documentation to facilitate efficient resolution.

Learning & Growth

• Learn from developers to deepen technical skills.
• Stay current with modern test automation frameworks, patterns, and tools, recommending improvements where valuable.
• Contribute to documentation of test suites, frameworks, and best practices.

Required Experience & Skills

• 5+ years’ experience in QA automation or software engineering roles with a testing focus.
• Google Vertex AI / Gemini integration testing .
• LLM output validation
• Experience developing automated tests for web applications (frontend or backend).
• Familiarity with at least one E2E / Browser Automation framework (e.g., Cypress, Playwright, Selenium) and one Unit Framework (xUnit, Jest, NUnit).
• Ability to read and write code in at least one programming language (JavaScript/TypeScript, C#, Python, or similar).
• Understanding of CI/CD pipelines and automated test execution.
• Ability to work within an agile engineering environment

Key Skills

Education

Any Gradute