Interface Tokenizer

interface Tokenizer {
    createSplitterRegexp(src, flag?): RegExp;
    getLineTokens(line, startState): Token[];
    removeCapturingGroups(src): string;
}

Methods

createSplitterRegexp getLineTokens removeCapturingGroups

Methods

createSplitterRegexp

  • createSplitterRegexp(src, flag?): RegExp

  • Parameters

    • src: string
    • Optional flag: string

    Returns RegExp

getLineTokens

  • getLineTokens(line, startState): Token[]

  • Parameters

    • line: string
    • startState: string | string[]

    Returns Token[]

removeCapturingGroups

  • removeCapturingGroups(src): string

  • Parameters

    • src: string

    Returns string

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc