Role & Responsibilities: Create and solve advanced physics problems designed to evaluate and improve large language models. Develop clear, accurate, step-by-step solutions and high-quality benchmark data. Analyze AI-generated responses and identify errors in reasoning, calculations, and concepts. Collaborate with AI/LLM researchers to design evaluation tasks and benchmarks. Work across physics topics ranging from advanced undergraduate to PhD-level concepts. Provide detailed feedback and annotations to support AI model improvement. Work independently in a remote, task-based environment while meeting quality and delivery requirements.
Preferred Candidate Profile: PhD or Doctorate in Physics, Applied Physics, or an equivalent technical field. Strong knowledge of physics and advanced problem-solving. Excellent analytical, research, and structured reasoning skills. Strong written English and ability to explain complex physics concepts clearly. Experience in AI evaluation, data annotation, content review, quality assurance, or similar analytical work is preferred but not mandatory. Comfortable working with AI/LLM-based tools and evaluating model responses. Self-motivated and able to work independently in a remote environment. Must have a personal laptop/desktop and reliable high-speed internet. Available for at least 4 hours per day, up to 40 hours per week, with 4 hours of PST overlap.

Also on the board Same function, level within a rung

Level

Senior

Location

New York, NY

Occupation

Physicists

Industry

All Other Professional, Scientific, and Technical Services

Posted

today

Apply for this role →