Skip to content
Vally

CLI: ingest

Usage

Section titled “Usage”
Terminal window
vally ingest <directory> [options]

Description

Section titled “Description”

Import eval results from an output directory into a SQLite database. This is useful for building up a historical database from multiple eval runs without starting a server.

The database can later be served with vally serve --store <path>.

Arguments

Section titled “Arguments”
Argument Description
<directory> Path to eval output directory

Options

Section titled “Options”
Flag Type Default Description
--store <path> string eval-history.db SQLite database file path

Exit codes

Section titled “Exit codes”
Code Meaning
0 Import completed
1 Error occurred

Behavior

Section titled “Behavior”
  • Scans the directory for timestamped subdirectories containing results.jsonl files
  • Each run is ingested once — re-running ingest on the same directory skips already-imported runs
  • Stores outcomes, grader results, tool call events, and raw JSONL for drill-down
  • Reports per-run outcome counts and totals

Examples

Section titled “Examples”
Terminal window
# Import results into the default database
vally ingest ./vally-results/


# Import into a specific database file
vally ingest ./vally-results/ --store my-evals.db


# Then serve from the database
vally serve ./vally-results/ --store my-evals.db