Class BackgroundTokenizer

constructor

• new BackgroundTokenizer(tokenizer, session?): BackgroundTokenizer

• Creates a new BackgroundTokenizer object.

  Parameters

  • tokenizer: Tokenizer

    The tokenizer to use

  • Optional session: EditSession

    The editor session to associate with

  Returns BackgroundTokenizer

$worker

currentLine

doc

lines

running

states

tokenizer

$tokenizeRow

• $tokenizeRow(row): Token[]

• Parameters

  • row: number

  Returns Token[]

$updateOnChange

• $updateOnChange(delta): void

• Parameters

  • delta: Delta

  Returns void

cleanup

• cleanup(): void

• Returns void

fireUpdateEvent

• fireUpdateEvent(firstRow, lastRow): void

• Emits the 'update' event. firstRow and lastRow are used to define the boundaries of the region to be updated.

  Parameters

  • firstRow: number

    The starting row region

  • lastRow: number

    The final row region

  Returns void

getState

• getState(row): string

• Returns the state of tokenization at the end of a row.

  Parameters

  • row: number

    The row to get state at

  Returns string

getTokens

• getTokens(row): Token[]

• Gives list of [[Token]]'s of the row. (tokens are cached)

  Parameters

  • row: number

    The row to get tokens at

  Returns Token[]

scheduleStart

• scheduleStart(): void

• Sets pretty long delay to prevent the tokenizer from interfering with the user

  Returns void

setDocument

• setDocument(doc): void

• Sets a new document to associate with this object.

  Parameters

  • doc: Document

    The new document to associate with

  Returns void

setTokenizer

• setTokenizer(tokenizer): void

• Sets a new tokenizer for this object.

  Parameters

  • tokenizer: Tokenizer

    The new tokenizer to use

  Returns void

start

• start(startRow): void

• Starts tokenizing at the row indicated.

  Parameters

  • startRow: number

    The row to start at

  Returns void

stop

• stop(): void

• Stops tokenizing.

  Returns void