energy jobline zrNew York, NY
AI Safety Specialist - Evaluation Expert in New York
$60–$70/hour
Apply (opens in a new tab)AI Safety Specialist - Evaluation Expert in New York
AI Safety Specialist - Evaluation Expert in New York
energy jobline zrNew York, NY
2 days ago
$60–$70/hour
Other Scientific and Technical Consulting ServicesAll Other Professional, Scientific, and Technical ServicesTemporary Help Services
Apply for this role (opens in a new tab)Job Description
About the job:
- Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark
- General Catalyst
- Peter ThielAdam D'AngeloLarry Summers, and Jack Dorsey
Position: AI Safety Practitioner Type:
Contract
Compensation: $60–$70/hour
Location:
- RemoteRole Responsibilities
- Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
- Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
- Apply and refine evaluation rubrics for RLHFSFT, and AI safety benchmarking
- Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
- Provide structured feedback to improve model alignment and safety performance.
- Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.
Qualifications
Must-Have:
Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field. Excellent written English, critical thinking, and analytical reasoning skills. Ability to consistently evaluate nuanced and policy-sensitive scenarios. Experience with AI SafetyRLHFSFT, Trust & Safety, or AI evaluation. Familiarity with safety policies, content moderation, or evaluation rubric development. Experience reviewing complex, high-risk, or ambiguous content.
Application Process:
- (Takes 20–30 mins to complete)
- Upload resumeAI interview based on your resume
- Submit form
- Resources & Support
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcomeFor any help or support, reach out to: support@mercor.comPS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Also on the board Same function, level within a rung
Level
Senior
Salary
$60–$70/hour
Location
New York, NY
Occupation
Editors
Industry
Other Scientific and Technical Consulting Services
Posted
2 days ago