Function tokenize

  • tokenize(text, languageId): Token[][]

  • Tokenize text using language languageId

    Parameters

    • text: string
    • languageId: string

    Returns Token[][]

Settings

Member Visibility

Theme