Description

You will validate and assure the quality of AI/ML systems powering real-time contextual advertising on live video streams.

This role is remote.

Responsibilities

• Validate AI-generated outputs against labelled datasets and expected outcomes.
• Design and implement automated testing frameworks in Python for multi-modal validation.
• Build validation harnesses for JSON parsing, schema comparison, and structured output verification.
• Execute system integration, end-to-end testing, and root cause analysis for defects.
• Collaborate with Applied Scientists to validate LLM and GenAI outputs.

Required Skills

• Strong Python scripting experience for automation and testing.
• 10+ years of experience in AI/ML model validation and QA workflows.
• Hands-on experience with JSON parsing, schema comparison, and data validation pipelines.
• Experience testing multi-modal AI systems (vision, NLP, audio) and LLM/GenAI outputs.
• Familiarity with AWS cloud environment, including S3, Lambda, and CloudWatch.
• Understanding of AI accuracy evaluation techniques and structured output validation.
• Ability to handle mixed manual and automated testing approaches.

Preferred Skills

• Experience with media/video content analysis workflows.
• Background in real-time streaming environments.

Key Skills

Education

Any Graduate