Description

You will design and execute large-scale testing strategies for voice AI systems, focusing on non-deterministic AI behaviors.

Responsibilities

• Develop and maintain test plans tailored for voice-based AI systems and in-car assistant platforms.
• Design test strategies for LLM interactions, modeling scenarios to validate conversational accuracy and safety.
• Build tools and automation pipelines to evaluate thousands of voice interactions and LLM outputs.
• Collaborate with engineering and product teams to simulate real-world in-car assistant environments.
• Analyze logs, triage issues, and report defects while contributing to internal QA frameworks.

Required Skills

• Proficiency in writing scripts using Python for test automation and data handling.
• Hands-on experience with test case design, bug tracking tools, and test management platforms.
• Strong analytical ability to simulate nuanced user behaviors beyond expected results.
• Understanding of QA within SDLC and STLC environments.
• Comfort with structured and unstructured test data generation.
• Familiarity with Langchain and Langgraph.
• Experience testing APIs, custom web applications, or data-intensive systems.
• Knowledge of logging/monitoring tools like Grafana or Kibana.

Key Skills

Education

Any Graduate