Interface InferenceResponse

Details for recording the response from an inference call.

interface InferenceResponse {
    content: string;
    finishReason?: string;
    inputTokens?: number;
    outputTokens?: number;
    responseId?: string;
}

Properties

content: string

The response content produced by the model.

finishReason?: string

Reason the model stopped generating.

inputTokens?: number

Number of input (prompt) tokens.

outputTokens?: number

Number of output (completion) tokens.

responseId?: string

Unique identifier of the response.