Commands

A full list of the CLI command and its respective help text.

run

Usage: genaiscript run [options] <script> [files...]

Runs a GenAIScript against files.

Options:
  -ef, --excluded-files <string...>          excluded files
  -egi, --exclude-git-ignore                 exclude files that are ignore through the .gitignore file in the workspace root
  -o, --out <string>                         output folder. Extra markdown fields for output and trace will also be generated
  -rmo, --remove-out                         remove output folder if it exists
  -ot, --out-trace <string>                  output file for trace
  -od, --out-data <string>                   output file for data (.jsonl/ndjson will be aggregated). JSON schema information and validation will be included if available.
  -oa, --out-annotations <string>            output file for annotations (.csv will be rendered as csv, .jsonl/ndjson will be aggregated)
  -ocl, --out-changelog <string>             output file for changelogs
  -prc, --pull-request-comment [string]      create comment on a pull request with a unique id (defaults to script id)
  -prd, --pull-request-description [string]  create comment on a pull request description with a unique id (defaults to script id)
  -prr, --pull-request-reviews               create pull request reviews from annotations
  -j, --json                                 emit full JSON response to output
  -y, --yaml                                 emit full YAML response to output
  -p, --prompt                               dry run, don't execute LLM and return expanded prompt
  -fe, --fail-on-errors                      fails on detected annotation error
  -r, --retry <number>                       number of retries (default: "8")
  -rd, --retry-delay <number>                minimum delay between retries (default: "15000")
  -md, --max-delay <number>                  maximum delay between retries (default: "180000")
  -l, --label <string>                       label for the run
  -t, --temperature <number>                 temperature for the run
  -tp, --top-p <number>                      top-p for the run
  -m, --model <string>                       model for the run
  -mt, --max-tokens <number>                 maximum tokens for the run
  -mdr, --max-data-repairs <number>          maximum data repairs
  -mtc, --max-tool-calls <number>            maximum tool calls for the run
  -se, --seed <number>                       seed for the run
  --no-cache                                 disable LLM result cache
  -cn, --cache-name <name>                   custom cache file name
  --cs, --csv-separator <string>             csv separator (default: "\t")
  -ae, --apply-edits                         apply file edits
  --vars <namevalue...>                      variables, as name=value, stored in env.vars
  -h, --help                                 display help for command

test

Usage: genaiscript test [options] [command]

Options:
  -h, --help                 display help for command

Commands:
  run [options] [script...]  Runs the tests for scripts
  view                       Launch test viewer
  help [command]             display help for command

test run

Usage: genaiscript test run [options] [script...]

Runs the tests for scripts

Arguments:
  script                              Script ids. If not provided, all scripts
                                      are tested

Options:
  --models <models...>                models to test where mode is the key
                                      value pair list of m (model), t
                                      (temperature), p (top-p)
  -o, --out <folder>                  output folder
  -rmo, --remove-out                  remove output folder if it exists
  --cli <string>                      override path to the cli
  -tp, --test-provider <string>       test provider
  -td, --test-delay <string>          delay between tests in seconds
  --no-cache                          disable LLM result cache
  -v, --verbose                       verbose output
  -pv, --promptfoo-version [version]  promptfoo version, default is ^0.67.0
  -os, --out-summary <file>           append output summary in file
  -h, --help                          display help for command

test view

Usage: genaiscript test view [options]

Launch test viewer

Options:
  -h, --help  display help for command

scripts

Usage: genaiscript scripts|script [options] [command]

Utility tasks for scripts

Options:
  -h, --help                display help for command

Commands:
  list                      List all available scripts in workspace
  create <name>             Create a new script
  fix                       fix all definition files
  compile                   Compile all script in workspace
  model [options] [script]  List model connection information for scripts
  help [command]            display help for command

scripts list

Usage: genaiscript scripts list [options]

List all available scripts in workspace

Options:
  -h, --help  display help for command

scripts create

Usage: genaiscript scripts create [options] <name>

Create a new script

Arguments:
  name        Name of the script

Options:
  -h, --help  display help for command

scripts fix

Usage: genaiscript scripts fix [options]

fix all definition files

Options:
  -h, --help  display help for command

scripts compile

Usage: genaiscript scripts compile [options]

Compile all script in workspace

Options:
  -h, --help  display help for command

scripts model

Usage: genaiscript scripts model [options] [script]

List model connection information for scripts

Arguments:
  script       Script id or file

Options:
  -t, --token  show token
  -h, --help   display help for command

cache

Usage: genaiscript cache [options] [command]

Cache management

Options:
  -h, --help      display help for command

Commands:
  clear [name]    Clear cache
  help [command]  display help for command

cache clear

Usage: genaiscript cache clear [options] [name]

Clear cache

Arguments:
  name        Name of the cache, tests

Options:
  -h, --help  display help for command

retrieval

Usage: genaiscript retrieval|retreival [options] [command]

RAG support

Options:
  -h, --help                           display help for command

Commands:
  index [options] <file...>            Index a set of documents
  search [options] <query> [files...]  Search using vector embeddings
                                       similarity
  clear [options]                      Clear index to force re-indexing
  fuzz [options] <query> [files...]    Search using string distance
  code
  help [command]                       display help for command

retrieval index

Usage: genaiscript retrieval index [options] <file...>

Index a set of documents

Arguments:
  file                               Files to index

Options:
  -ef, --excluded-files <string...>  excluded files
  -n, --name <string>                index name
  -cs, --chunk-size <number>         chunk size
  -co, --chunk-overlap <number>      chunk overlap
  -m, --model <string>               model for embeddings
  -t, --temperature <number>         LLM temperature
  -h, --help                         display help for command

retrieval search

Usage: genaiscript retrieval search [options] <query> [files...]

Search using vector embeddings similarity

Options:
  -ef, --excluded-files <string...>  excluded files
  -tk, --top-k <number>              maximum number of results
  -n, --name <string>                index name
  -h, --help                         display help for command

retrieval clear

Usage: genaiscript retrieval clear [options]

Clear index to force re-indexing

Options:
  -n, --name <string>  index name
  -h, --help           display help for command

retrieval fuzz

Usage: genaiscript retrieval fuzz [options] <query> [files...]

Search using string distance

Options:
  -ef, --excluded-files <string...>  excluded files
  -tk, --top-k <number>              maximum number of results
  -h, --help                         display help for command

retrieval code

Usage: genaiscript retrieval code [options]

Options:
  -h, --help  display help for command

serve

Usage: genaiscript serve [options]

Start a GenAIScript local server

Options:
  -p, --port <number>  Specify the port number, default: 8003
  -h, --help           display help for command

parse

Usage: genaiscript parse|parsers [options] [command] <file...>

Parse various outputs

Arguments:
  file                         input JSONL files

Options:
  -h, --help                   display help for command

Commands:
  fence <language>             Extracts a code fenced regions of the given type
  pdf <file>                   Parse a PDF into text
  docx <file>                  Parse a DOCX into texts
  html-to-text [file]          Parse an HTML file into text
  code <file> [query]          Parse code using tree sitter and executes a
                               query
  tokens [options] <files...>  Count tokens in a set of files
  jsonl2json                   Converts JSONL files to a JSON file

parse fence

Usage: genaiscript parse fence [options] <language>

Extracts a code fenced regions of the given type

Options:
  -h, --help  display help for command

parse pdf

Usage: genaiscript parse pdf [options] <file>

Parse a PDF into text

Options:
  -h, --help  display help for command

parse docx

Usage: genaiscript parse docx [options] <file>

Parse a DOCX into texts

Options:
  -h, --help  display help for command

parse html-to-text

Usage: genaiscript parse html-to-text [options] [file]

Parse an HTML file into text

Options:
  -h, --help  display help for command

parse code

Usage: genaiscript parse code [options] <file> [query]

Parse code using tree sitter and executes a query

Options:
  -h, --help  display help for command

parse tokens

Usage: genaiscript parse tokens [options] <files...>

Count tokens in a set of files

Options:
  -ef, --excluded-files <string...>  excluded files
  -h, --help                         display help for command

parse jsonl2json

Usage: genaiscript parse jsonl2json [options]

Converts JSONL files to a JSON file

Options:
  -h, --help  display help for command

info

Usage: genaiscript info [options] [command]

Utility tasks

Options:
  -h, --help  display help for command

Commands:
  help        Show help for all commands
  system      Show system information

info help

Usage: genaiscript info help [options]

Show help for all commands

Options:
  -h, --help  display help for command

info system

Usage: genaiscript info system [options]

Show system information

Options:
  -h, --help  display help for command