Grader: completed / exit-success

Two graders with different strictness levels for checking session health.

completed (strict)

Checks three conditions:

1. Agent produced non-empty output
2. No error events in the trajectory
3. At least one turn completed (has a turn_end event)

Taxonomy

Property	Value
Determinism	static
Cost	free
Portability	t1-universal
Reference	reference-free
Temporal scope	trajectory-level
Score kind	code

Config

No configuration needed:

graders:
  - type: completed

Evidence examples

✔ Agent session completed successfully
✘ Agent produced no output
✘ 2 error event(s) in trajectory
✘ No turn_end events found — session may have crashed mid-turn

---

exit-success (legacy compat)

Checks only that the agent produced non-empty output. This matches the semantics of vally’s exit_success assertion type — use it when porting evals from skill-validator.

Does NOT check for errors or turn completion. Use completed if you want the stricter check.

Config

No configuration needed:

graders:
  - type: exit-success

Evidence examples

✔ Agent completed successfully
✘ Agent produced no output