Description

You will analyze and evaluate code responses generated by Large Language Models to determine accuracy and quality.

Responsibilities

• Evaluate the effectiveness and correctness of Python code produced by LLMs.
• Assess model performance under specific conditions against reference standards.
• Analyze code syntax, semantics, and grammatical structure for errors.
• Compare outputs from different models to identify performance gaps.

Required Skills

• Strong proficiency in Python programming language.
• Expert-level English proficiency, including grammar, syntax, and semantics.
• Experience analyzing code generated by LLMs (e.g., GPT, Gemini, BERT).
• 3+ years of professional experience in software analysis or linguistic evaluation.
• Strong analytical and problem-solving capabilities.
• Ability to collaborate effectively with engineering teams.

Key Skills

Education

Any Graduate