Interface EncodedTokensProvider

A "manual" provider of tokens, returning tokens in a binary form.

interface EncodedTokensProvider {
    getInitialState(): IState;
    tokenize?(line, state): ILineTokens;
    tokenizeEncoded(line, state): IEncodedLineTokens;
}

Index

Methods

getInitialState tokenize? tokenizeEncoded

Methods

getInitialState

getInitialState(): IState
The initial state of a language. Will be the state passed in to tokenize the first line.

Returns IState
- Defined in editor.api.d.ts:6353

`Optional` tokenize

tokenize(line, state): ILineTokens
Tokenize a line given the state at the beginning of the line.
Parameters
- line: string
- state: IState
Returns ILineTokens
- Defined in editor.api.d.ts:6361

tokenizeEncoded

tokenizeEncoded(line, state): IEncodedLineTokens
Tokenize a line given the state at the beginning of the line.
Parameters
- line: string
- state: IState
Returns IEncodedLineTokens
- Defined in editor.api.d.ts:6357