Software Engineering Director, Agentic Evaluations

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Software Engineering Director, Agentic Evaluations based in United States.

This role will lead the engineering strategy and execution behind credible, scalable evaluations of AI agents offered by software vendors. You will own the core evaluation platform, from APIs and administration tools through workflow orchestration and production delivery. The position combines deep backend engineering with hands-on experience evaluating customer-facing AI agents using modern LLMs and agentic techniques. You will design reusable evaluation infrastructure that can scale across software categories and accelerate the launch of new benchmarks. Alongside building the platform, you will lead and mentor a team of engineers and serve as a technical authority on agent evaluation. This is an opportunity to shape how agent performance, accuracy, reliability, and policy adherence are measured in an AI-driven software ecosystem.

How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best!  Why Apply Through Jobgether?    Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.     #LI-CL1