Description

You will evaluate the accuracy and quality of C++ code responses generated by Large Language Models.

Responsibilities

• Analyze code outputs from models like GPT, Gemini, and BERT for correctness and style.
• Evaluate effectiveness under specific conditions to determine model performance.
• Assess English grammar, syntax, and semantics in generated technical documentation and comments.
• Provide detailed feedback on quality metrics to guide model improvement.
• Collaborate with engineering teams to refine evaluation criteria.

Required Skills

• Strong proficiency in C++ programming.
• Expert-level English proficiency, including grammar and syntax.
• Experience with Large Language Models (LLMs) and their outputs.
• Strong analytical and problem-solving capabilities.
• Ability to evaluate code quality and logical consistency.
• 3+ years of relevant professional experience.

Key Skills

Education

Any Graduate