Skip to main content
The Occupation-Specific Reviewer evaluates task submissions that require domain expertise in a specific profession or field (e.g., healthcare, law, education, engineering, finance, software development). This role ensures that content is not only guideline-compliant, but also professionally accurate, realistic, and aligned with real-world standards of practice. Occupation-Specific Reviewers are trusted subject matter experts who apply both formal evaluation criteria and professional judgment, while maintaining strict adherence to safety, compliance, and scope boundaries.
Key Responsibilities:
  • Review submissions requiring professional or technical domain knowledge
  • Validate factual accuracy, terminology, and real-world applicability within the domain
  • Ensure outputs remain within allowed scope and do not provide unsafe, misleading, or non-compliant guidance
  • Evaluate alignment with professional standards, norms, and best practices
  • Apply platform guidelines consistently, even when they conflict with personal preference or real-world shortcuts
  • Provide precise, educational, and corrective feedback grounded in both guidelines and domain expertise
  • Identify high-risk errors related to safety, ethics, or misuse
  • Escalate ambiguous or high-impact issues appropriately
  • Maintain clear documentation of review decisions and reasoning
Required Qualifications:
  • 5+ years of professional experience practicing in that domain
  • Demonstrated experience with: Evaluation, review, auditing, or supervisory responsibilities OR Teaching, mentoring, training, or assessing professional work
  • Strong understanding of professional boundaries, risk, and compliance considerations
  • Excellent written communication skills suitable for formal feedback
Preferred Qualifications:
  • Prior experience reviewing AI-generated or training data content
  • Familiarity with compliance, regulatory, or ethical standards in the field
  • Experience translating expert knowledge into clear, structured explanations
  • Comfort working with evolving guidelines and iterative feedback cycles
  • Risk awareness and safety judgment
  • Clear, corrective feedback
  • Professional integrity
  • Strict adherence to confidentiality and data protection requirements
  • Consistent application of guidelines across all reviews
  • Willingness to update evaluation approach as standards evolve
  • Professional, unbiased, and respectful communication at all times
  • Compensation & Logistics$40 to $60 per hour, depending on expertise and relevance, with bonuses for key contributions
  • Begins with a paid trial period
  • Paid every two weeks based on approved and tracked hours
  • Fully remote and async friendly, work at your own pace within flexible deadlines
Employment type: Contract, flexible hours (part-time and full-time options).

Also on the board Same function, level within a rung

Level

Senior

Salary

$40 to $60 per hour

Location

New York, NY

Occupation

Document Management Specialists

Industry

All Other Professional, Scientific, and Technical Services

Posted

2 days ago

Apply for this role (opens in a new tab)