Description

Own end-to-end test strategy and automation frameworks for UI, API, and data layers, with specific focus on validating Generative and Agentic AI systems.

This role is on-site.

Responsibilities

• Define and own test strategy, coverage, and quality gates.
• Design scalable automation frameworks for UI, API, and data layers.
• Build and integrate automated regression and smoke suites into CI/CD pipelines.
• Validate Generative AI systems (LLMs, embeddings, vector search) for correctness, safety, and performance.
• Partner with AI/ML and product teams to define testable requirements and evaluation frameworks.

Required Skills

• 5+ years in QA and test automation.
• Strong hands-on experience with Selenium, API testing, and automation frameworks.
• Proficiency in Java, Python, or JavaScript.
• Experience testing Generative AI, LLMs, or Agentic AI systems.
• Ability to detect prompt issues, hallucinations, and output drift.
• Experience integrating automation into CI/CD pipelines.
• Strong understanding of test strategy, defect management, and quality metrics.
• Experience working in Agile environments.

Preferred Skills

• Experience building regression tests for AI-driven systems.
• Background in testing embeddings and vector search pipelines.

Key Skills

Education

Any Graduate