Description

You will work on projects to fine-tune large language models by solving complex STEM problems and evaluating model reasoning.

Responsibilities

• Design and solve challenging STEM problems to probe the limitations of large language models.
• Create high-quality, step-by-step solutions with well-articulated reasoning.
• Collaborate with LLM researchers to align problems with evaluation goals in areas like abstraction and symbolic manipulation.
• Define new evaluation benchmarks based on STEM curricula ranging from undergraduate to PhD-level topics.
• Provide detailed annotations and constructive feedback on model outputs.

Required Skills

• Strong foundation in Physics, Chemistry, Mathematics, or Biology (STEM).
• Ability to solve complex STEM problems using a structured and logical approach.
• Capability to break down complex concepts into simple, clear, and structured explanations.
• Advanced research and analytical skills.
• Excellent structured communication and collaboration skills for a remote environment.
• Ability to work independently and self-motivate in a remote setting.
• Creative and lateral thinking abilities.

Preferred Skills

• Currently pursuing a Master’s, PhD, or Postdoctoral degree in a STEM field.
• Experience using visuals or simulations to explain STEM concepts.

Key Skills

Education

Not specified