CLI: export

Usage

vally export --eval-spec <path> --exporter <specifier> [options] [-- key=value ...]

Description

Convert an eval spec to a format consumed by another evaluation tool. The export command validates the eval spec, resolves environments and stimuli, loads an exporter plugin, and invokes it to generate output files.

Options

Flag	Type	Required	Description
--eval-spec <path>	string	Yes	Path to eval.yaml file
--exporter <specifier>	string	Yes	Exporter plugin to load (npm package name or local path)
--grader-plugin <specifier>	string	No	Grader plugin to load (npm package name or local path). Prevents unknown-grader-type errors for plugin graders during validation.
--output-dir <dir>	string	No	Directory for output files (default: ./<exporter-name>/)
--tag <key=values>	string	No	Filter stimuli by tag (repeatable, e.g., --tag cost=free,low)
--verbose	boolean	No	Show resolved eval schema and plugin details

Exporter-specific options

Options after -- are forwarded to the exporter plugin as key=value pairs.

Exporter resolution

The --exporter specifier is resolved differently depending on its shape:

Specifier type	Examples	Resolved from
Local path	./my-exporter, ../plugins/exp, /abs/path	Current working directory
Bare package name	@contoso/vally-exporter-foo, my-exporter	Eval project directory (dirname(eval.yaml))

Exit codes

Code	Meaning
0	Export completed successfully
1	Validation error, plugin load failure, or export error

Examples

Basic export

vally export --eval-spec eval.yaml --exporter @contoso/vally-exporter-foo

With output directory and tag filter

vally export --eval-spec ./evals/my-eval/eval.yaml \
  --exporter @contoso/vally-exporter-foo \
  --output-dir ./exported \
  --tag cost=free,low

Pass exporter-specific options

vally export --eval-spec eval.yaml \
  --exporter @contoso/exporter \
  -- baseImage=ubuntu:22.04 format=compact