## Uses of Class
org.apache.sysds.runtime.transform.tokenize.Token

Packages that use Token
org.apache.sysds.runtime.transform.tokenize
org.apache.sysds.runtime.transform.tokenize.builder

### Uses of Token in org.apache.sysds.runtime.transform.tokenize

Fields in org.apache.sysds.runtime.transform.tokenize with type parameters of type Token
`List<Token>` DocumentRepresentation.`tokens`

Methods in org.apache.sysds.runtime.transform.tokenize that return types with arguments of type Token
`List<Token>` DocumentRepresentation.`getTokens()`

Constructor parameters in org.apache.sysds.runtime.transform.tokenize with type arguments of type Token
`Token​(List<Token> subList)`

### Uses of Token in org.apache.sysds.runtime.transform.tokenize.builder

Methods in org.apache.sysds.runtime.transform.tokenize.builder that return types with arguments of type Token
`List<Token>` TokenizerBuilderNgram.`splitIntoNgrams​(Token token, int minGram, int maxGram)`
`List<Token>` TokenizerBuilderWhitespaceSplit.`splitToTokens​(String text)`

Methods in org.apache.sysds.runtime.transform.tokenize.builder with parameters of type Token
`List<Token>` TokenizerBuilderNgram.`splitIntoNgrams​(Token token, int minGram, int maxGram)`