AI Operations Specialist - STEM

Responsibilities: Evaluate AI-generated content for technical accuracy, reasoning, completeness, and relevance. Create or review expert responses, explanations, and reasoning examples. Compare, rank, annotate, classify, and validate model outputs using defined criteria. Identify scientific, mathematical, technical, logical, or methodological errors. Evaluate multimodal content such as text, images, charts, equations, and code. Support model safety, red-teaming, and validation activities as required. Apply project guidelines consistently and document evaluation rationale when needed. Meet established quality, productivity, attendance, and scheduled-hour requirements.

Qualifications: 10+ years of directly relevant professional experience OR Doctorate in a relevant STEM discipline. Specialties: Biology, Chemistry, Mathematics, Physics, Statistics, Computer Science, Engineering, and related fields. Advanced expertise in the applicable STEM field. Strong analytical, critical-thinking, and problem-solving skills. Ability to independently evaluate complex technical reasoning and identify substantive errors. Strong written communication and attention to detail. Ability to work effectively within structured, technology-enabled workflows.

Preferred Qualifications: Experience reviewing, teaching, publishing, or developing advanced technical content. Experience with AI evaluation, annotation, preference ranking, red teaming, or similar work. Familiarity with generative AI and large language models. SkillsTools/Platforms Data Annotation Platforms Preference Ranking Tools AI Model Validation Tools Red Teaming Tools / Environments Generative AI / LLM Platforms AI Evaluation Platforms Common Methodologies/Frameworks Customer Support Workflow Management AI Response Ranking & Preference Evaluation AI Reasoning Evaluation Human-in-the-Loop (HITL) AI Evaluation AI Model Evaluation Data Annotation & Classification Technical Accuracy Validation General Skills Quality Assurance Cross-functional Collaboration Research Methodologies Soft Skills Attention to Detail Time Management Critical Thinking

Education & Experience: EducationDoctorateMinimumExperience10+ Years

Additional Requirements: Technological Requirements Either Mac or Windows Language English City/Province/Country London, London, United Kingdom