Description

You will evaluate, annotate, and validate complex AI model outputs and datasets to ensure high-quality training data.

This role is remote.

Responsibilities

• Evaluate AI model responses for code quality, inefficiencies, and standard compliance.
• Generate, annotate, and label code snippets and technical documentation per established guidelines.
• Provide detailed, constructive feedback on model outputs and compare multiple results based on correctness and efficiency.
• Validate and correct training datasets to ensure high data quality.
• Collaborate with data scientists and engineers to define annotation guidelines and resolve ambiguities.

Required Skills

• 8+ years of professional experience in software engineering or a related technical field.
• Expertise in Python.
• Proficiency in at least one of JavaScript, Rust, Node.js, TypeScript, C, or C++.
• Knowledge of SQL, NoSQL, and SQLite database management.
• Solid understanding of version control using Git/GitHub.
• Familiarity with clean code principles and software design patterns.
• Strong analytical skills for troubleshooting complex coding solutions.
• Meticulous attention to detail when following multi-step instructions.

Preferred Skills

• Experience working with large language models and AI training pipelines.

Key Skills

Education

Any Gradute