Choices

You can specify a list of preferred words (choices) in the script metadata. It will increase the probability of the model generating the specified words.

• Each word should match a single token for the desired model!
• For some models, GenAIScript does not have a token encoder so it won’t be able to compute the logit bias for the choices

script({
    choices: ["OK", "ERR"],
})
...

ERR

Logit Bias

Internally, GenAIScript tokenizes the word and build the logit_bias for each token.

• choices: OK, ERR
• logit bias: {"5175":5,"5392":5}

Logprobs

You can enable logprobs to visualize the confidence of the tokens generated by the model.

---

ERR .

---