|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||
| Packages that use TokenStream.BasicTokenizer | |
|---|---|
| org.modeshape.common.text | A set of utilities for working with text. |
| Uses of TokenStream.BasicTokenizer in org.modeshape.common.text |
|---|
| Methods in org.modeshape.common.text that return TokenStream.BasicTokenizer | |
|---|---|
static TokenStream.BasicTokenizer |
TokenStream.basicTokenizer(boolean includeComments)
Obtain a basic TokenStream.Tokenizer implementation that ignores whitespace but includes tokens for individual symbols, the
period ('.'), single-quoted strings, double-quoted strings, whitespace-delimited words, and optionally comments. |
|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||