Skip to main content

token_count_utils

token_left​

def token_left(input: Union[str, List, Dict],
               model="gpt-3.5-turbo-0613") -> int

Count number of tokens left for an OpenAI model.

Arguments:

  • input - (str, list, dict): Input to the model.
  • model - (str): Model name.

Returns:

  • int - Number of tokens left that the model can use for completion.

count_token​

def count_token(input: Union[str, List, Dict],
                model: str = "gpt-3.5-turbo-0613") -> int

Count number of tokens used by an OpenAI model.

Arguments:

  • input - (str, list, dict): Input to the model.
  • model - (str): Model name.

Returns:

  • int - Number of tokens from the input.

num_tokens_from_functions​

def num_tokens_from_functions(functions, model="gpt-3.5-turbo-0613") -> int

Return the number of tokens used by a list of functions.

Arguments:

  • functions - (list): List of function descriptions that will be passed in model.
  • model - (str): Model name.

Returns:

  • int - Number of tokens from the function descriptions.