Description

You will design and implement evaluation frameworks and coding challenges to assess automated AI coding agents.

This role is remote.

Responsibilities

• Create challenging and realistic software engineering tasks for AI systems evaluation.
• Design self-contained coding challenges to test automated coding agent capabilities.
• Configure development environments for complex technical projects and testing scenarios.
• Build reliable evaluation frameworks to assess AI-powered coding system performance.
• Debug complex software issues and explore unfamiliar codebases for problem resolution.

Required Skills

• 5+ years of experience in software development and engineering.
• Proficiency in Python, Java, JavaScript, or C++.
• Strong problem-solving and debugging skills.
• Experience with AI systems and testing methodologies.
• Ability to work with unfamiliar codebases.

Preferred Skills

• Experience with automated coding agents and evaluation frameworks.
• Background in innovative AI projects.

Key Skills

Education

Any Graduate