TokenizerFunction type
Signature for an alternate word breaker.
type TokenizerFunction = (text: string, locale?: string) => Token[]
Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.