← Back to jobs

New York Technology Partners Logo
AI Quality Engineer

New York Technology Partners

 

Toronto, ON, Canada

Posted On: 15+ days ago
Experience: 5+ years
Availability: Hybrid
Openings: 2
Category: GenAI Quality Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will validate LLMs, GenAI workflows, and AI-driven applications through automation and rigorous testing.

This role is on-site.

Responsibilities

  • Build and maintain automated test suites specifically for AI applications.
  • Validate AI outputs, including hallucination detection and prompt adherence.
  • Design and execute automated functional, integration, and API tests.
  • Contribute to the overall quality strategy for next-generation AI features.

Required Skills

  • 4-6 years experience as a Software Engineer, SDET, or Automation Engineer.
  • Strong coding proficiency in Python, TypeScript, or Java.
  • Practical experience using LLMs and prompt engineering techniques.
  • Hands-on experience building automation scripts and testing tools.
  • Experience with AI/ML frameworks including LangChain, Hugging Face, and GPT models.
  • Proficiency in Python testing frameworks like PyTest.
  • Familiarity with agentic AI systems such as LangGraph or AutoGen.
  • Experience testing RESTful APIs and building automated API suites.

Preferred Skills

  • Working knowledge of the software development lifecycle and defect tracking.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs