[Agentic AI] Systems Evaluation Engineer

Responsibilities: Define success metrics. Create benchmarking frameworks. Analyze customer outcomes. Produce executive performance reports. Contributes to technology strategy and engineering roadmaps around software engineering; executes strategic software engineering proof of concepts. Interacts with user management regarding project status and user requirements to promote an environment with improved productivity and satisfaction. Supervises the work of external engineering vendors, analyzing the testing performed by vendors, and provides feedback and expertise to technicians. Identifies, recommends and implements changes to enhance effectiveness of engineering, implementation and service strategies.

Education & Experience: RecommendedFour-year or Graduate Degree in Computer Science, Statistics, Software Engineering, or any other related discipline or commensurate work experience or demonstrated competence. Typically has 7-10 years of work experience, preferably in software designing & development, software architecture, programming languages, or a related field. Strong analytical skills. Experience with benchmarking methodologies.

Preferred Qualifications: AI systems evaluation. Telemetry analytics Performance benchmarking. Linux and Windows validation experience. Preferred CertificationsProgramming Language/s Certification (Java, C++, Python, JavaScript, or similar) Knowledge & SkillsAgile Methodology Amazon Web Services Application Programming Interface (API) Automation C++ Computer Science DevOps Docker (Software) Full Stack Development Java (Programming Language) JavaScript (Programming Language) Kubernetes Microservices Microsoft Azure Python (Programming Language) React.js Scalability Software Development Software Engineering SQL (Programming Language) The pay range for this role is $130,700 to $205,200 USD annually with additional opportunities for pay in the form of bonus and/or equity (applies to United States of America candidates only). Pay varies by work location, job-related knowledge, skills, and experience. BenefitsHealth insurance Dental insurance Vision insurance Long term/short term disability insurance Employee assistance program Flexible spending account Life insurance Generous time off policies, including; 4-12 weeks fully paid parental leave based on tenure 11 paid holidays Additional flexible paid vacation and sick leave (US benefits overview) JobJob - Software

Schedule: Full time

Shift: No shift premium (United States of America)

Travel: 25% Relocation - Equal Opportunity Employer (EEO) - HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s). Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence. For more information, review HP’s EEO Policy or read about your rights as an applicant under the law here: “Know Your Rights: Workplace Discrimination is Illegal" You want to reshape the way the world works. So do we. You’re looking for more than just a job; you’re looking to make a difference. That means creating something new. Something that matters. Something that changes how the world works for the better. A career at HP can help you build the tomorrow you want. Let’s grow together. Privacy, Terms of Use, and AccessibilityOur founders believed that business exists when people work together to ‘accomplish something collectively which they could not accomplish separately.’ We uphold a zero-tolerance policy towards discrimination and treat everyone with respect. By maintaining these principles, we empower the HP team to contribute to our collective success and the future of work. Learn more about HP personal data practices at Privacy Statement, Personal Data Rights Notice (where applicable), accessibility at HP, and Terms. You can be yourself at HP. Learn more