AI Evaluation Specialist

Key responsibilities: Plan and execute hands-on evaluations of AI tools using representative business scenarios and workflows Design and maintain standardized evaluation frameworks, scorecards, and acceptance criteria for AI tools and models Conduct comparative evaluations and proof-of-concept assessments across multiple AI products and vendorsRequired qualifications 5+ years of experience in model evaluation and quality assurance of AI-enabled products or services Experience developing structured evaluation plans, scoring rubrics, and measurable acceptance criteria Hands-on experience with generative AI tools and large language models, including prompt design and output analysis Familiarity with common generative AI architectures and capabilities, including APIs and enterprise search Bachelor's degree