tokens(for:)
Tokenizes the string within the provided range.
Declaration
@nonobjc func tokens(for range: Range<String.Index>) -> [Range<String.Index>]Parameters
- range:
The range within the string that should be tokenzied.
Return Value
Returns the ranges corresponding to the tokens for the tokenizer’s unit that intersect the given range.