Set the tokens provider for a language (manual implementation). This tokenizer will be exclusive
with a tokenizer created using setMonarchTokensProvider, or with registerTokensProviderFactory,
but will work together with a tokens provider set using registerDocumentSemanticTokensProvider
or registerDocumentRangeSemanticTokensProvider.
Set the tokens provider for a language (manual implementation). This tokenizer will be exclusive with a tokenizer created using
setMonarchTokensProvider
, or withregisterTokensProviderFactory
, but will work together with a tokens provider set usingregisterDocumentSemanticTokensProvider
orregisterDocumentRangeSemanticTokensProvider
.