GitHub Models Evals

GitHub Models is a service that allows to run inference through your GitHub subscription. PromptPex was integrated as the generate command.

gh models generate

PromptPex is integrated in the models extension for the GitHub CLI.

gh models generate summarizer.prompt.yml

Install the runner

• install the GitHub CLI (already installed in the GitHub Codespace)

• install the GitHub Models extension

gh extension install https://github.com/github/gh-models