AI Agent Reliability

AI Agent Evaluation: Test the Decision, the Path, and the Effect

For operators accountable for AI-assisted work who need evidence that a workflow change is safe enough to release, not one impressive demo or a generic benchmark.

Uli PrantzBuilds and operates all-agents
Published
Key takeaways

Key takeaways

  • Evaluate the business decision and permitted effect, not whether the answer sounds polished. A good response that takes an unauthorized action still fails.
  • Build a versioned case set from ordinary traffic, edge cases, known failures and adversarial inputs; preserve a held-out release set.
  • Score deterministic checks with exact assertions, model judgment with criterion-level human labels, and agent paths with trace and side-effect checks.
  • Set slice-level gates before the run. An average can pass while one language, channel or high-consequence case fails completely.
  • Every corrected production miss should become a regression case, but keep test examples separate from the material used to tune the system.
AI agent evaluation is a versioned test of whether a specific workflow makes the right decision, follows the permitted path, and produces only the allowed effects on representative cases. Define success and failure before running it, combine exact assertions with calibrated human judgment, gate releases by important slices, and turn corrected production misses into regression cases.

Evaluate the job contract, not the model in isolation

A model benchmark can help compare general capabilities, but an operator needs to know whether one configured system can perform one bounded job. The evaluation unit therefore includes the instructions, retrieved context, tools, permissions, workflow code, approval gates and destination effects — all versioned together.

OpenAI's current evaluation guidance describes task-specific tests, production-shaped datasets, automated scoring where possible, human calibration and continuous evaluation. Its workflow example evaluates each nondeterministic interaction separately. The method here extends that logic to the surrounding deterministic path and real-world effect.

Four layers of an agent evaluation and the question each answers.
LayerQuestionBest evidence
Input contractDid the run receive valid, permitted and current information?Schema, provenance, access and freshness assertions
DecisionWas the classification, extraction or recommendation acceptable?Reference labels and criterion-level human judgment
PathDid it call permitted tools in an acceptable order and stop at gates?Trace events, tool arguments, budgets and state transitions
EffectDid the outside system change exactly as authorized?Destination reconciliation, idempotency and absence-of-effect checks

A polished answer can pass the decision layer and fail the path because it queried an unauthorized source. A correct plan can fail the effect layer because a retry sent twice. Do not compress these into one score before diagnosing them.

Build a case set that represents ordinary work and known danger

  1. 01Define the objective and disallowed outcomesHuman approval
    Write the job, population, success condition, permitted actions, hard failures and owner. “Helpful” is not a testable objective.
  2. 02Stratify the real populationCode
    Measure channel, language, category, customer tier, input length, tool path and consequence class. Sample typical traffic using those distributions.
  3. 03Add edges and historic failuresHuman approval
    Include missing fields, conflicting sources, duplicates, timeouts, policy changes, prompt attacks and every corrected production miss that should never recur.
  4. 04Create reference decisionsHuman approval
    Have qualified people label criteria, acceptable alternatives and required escalation. Preserve disagreement rather than forcing false certainty.
  5. 05Split development and release setsCode
    Tune on one partition and keep the release set hidden from the change process. Version membership, references and source dates.

Synthetic cases are useful for rare boundaries and adversarial inputs, but they must not replace production-shaped data. Track case origin so a high score on generated examples cannot masquerade as live performance.

Protect customer information with purpose limitation, redaction and access controls. A copied production transcript is not automatically safe evaluation data merely because it stays inside an engineering tool.

Match the grader to the type of claim

Use the most deterministic grader that can validly test the requirement.
RequirementGraderFailure example
Schema and allowed valuesExact validationOutput adds an unsupported category
Numeric or source-grounded factSource comparison with tolerance or exact matchQuoted amount differs from system of record
Policy criterionHuman-labeled criterion; calibrated model grader may assistExplanation omits a required limitation
Tool path and permissionTrace assertionWrite tool called before approval
External side effectDestination-state assertionTwo records created for one business key
Safe abstentionRequired state transitionSystem guesses when evidence conflicts

A model grader should judge one clearly defined criterion and return evidence, not a vague overall preference. Calibrate it against repeated human labels, measure disagreement by slice and keep a human adjudication path. Human review itself also needs a rubric and overlap set; “gold” labels are not gold when qualified reviewers interpret the rule differently.

Set release gates before seeing the candidate result

Simulated release decisionSimulated example data
A support triage workflow is tested on 600 held-out tickets across email, chat, three languages, six intent categories and four hard-stop types. The candidate improves overall intent accuracy from 88% to 91%, but security-report recall falls from 100% to 92% and two conflicting-account cases route automatically instead of abstaining. The predeclared gate requires 100% on both hard-stop slices. The release fails even though the average improved. The team fixes the abstention rule, adds the two misses to the regression set and reruns the unchanged release set plus new cases.

Define exact hard stops for unauthorized effects, privacy leakage, missed approval gates and duplicate writes. Then define minimum performance by important category, language or source channel, plus allowed regression from the current version. Report confidence intervals or case counts; “95% accurate” without the denominator and composition is not actionable.

Test multiple runs for nondeterministic steps. One pass shows possibility, not consistency. Preserve model/version, parameters, prompts, tool versions, timestamps and raw traces so the result can be reproduced.

Evaluation continues after release without grading customers in secret

  • Shadow first: compare proposed decisions with the live path without taking the external effect.
  • Canary narrowly: release to a bounded, reversible slice with a stop rule and named owner.
  • Sample continuously: review random cases and high-risk triggers, separating their statistics.
  • Detect drift: watch input mix, abstention, corrections, tool errors, latency and slice-level quality.
  • Close the loop: preserve a corrected miss as a versioned regression case, then prove the fix against cases that already worked.

The evaluation record should name the workflow version, dataset version, graders, thresholds, results, failures, decision owner and release outcome. This is the evidence behind “we tested it,” not a dashboard screenshot.

Use AI agent failure recovery to design what happens when a production run crosses one of the boundaries the evaluation was meant to protect.

Limitations and when not to use this

  • Passing an evaluation supports a bounded release decision for the tested workflow, population and version. It is not certification of a model or proof of performance in every context.
  • Benchmarks, synthetic cases and model-based graders can complement but not replace representative local data and qualified human judgment for consequential work.
  • Do not use evaluation results to make automated decisions about workers or customers. Define separate qualified review and governance for any individual consequence.

Sources

  1. Evaluation best practicesOpenAI Accessed 3 August 2026
  2. Working with evalsOpenAI Accessed 3 August 2026
  3. Artificial Intelligence Risk Management Framework 1.0NIST Accessed 3 August 2026

Inventory the variable steps

Classify one workflow step and export the minimum test and control contract for it.

Inventory the variable steps
About the author

Uli Prantz

Builds and operates all-agents

Uli Prantz builds all-agents, the process-automation platform this site documents. He writes about the operational side of automating recurring business work: where deterministic code beats model judgment, where it does not, and where a human still has to approve.

Bring one process. We will scope it in 30 minutes.

You leave the call knowing whether it is a fit, what can become code and what still needs a person.

Book a discovery call