auraoneNew York, NY
Remote Helpfulness Ranking Evaluator & Rubric Calibration
Remote Helpfulness Ranking Evaluator & Rubric Calibration
Training and Development SpecialistsCompensation, Benefits, and Job Analysis SpecialistsSoftware Quality Assurance Analysts and Testers
Other Management Consulting ServicesCustom Computer Programming ServicesAdministrative Management and General Management Consulting Services
Apply for this role (opens in a new tab)AuraOne, Inc. is seeking a remote Helpfulness Ranking Reward Model Evaluator to assess paired model outputs against a versioned rubric. You will label edge cases, annotate severity, and generate structured feedback to help retrain the model.
This contractor role requires careful written reasoning, attention to detail, and reliable availability for at least 10 hours per week, with compensation discussed after interviews.
Also on the board Same function, level within a rung
Level
Mid
Location
New York, NY
Occupation
Training and Development Specialists
Industry
Other Management Consulting Services
Posted
12 days ago