Uses of Class

Packages that use TokenStream.BasicTokenizer
org.modeshape.common.text A set of utilities for working with text. 

Uses of TokenStream.BasicTokenizer in org.modeshape.common.text

Methods in org.modeshape.common.text that return TokenStream.BasicTokenizer
static TokenStream.BasicTokenizer TokenStream.basicTokenizer(boolean includeComments)
          Obtain a basic TokenStream.Tokenizer implementation that ignores whitespace but includes tokens for individual symbols, the period ('.'), single-quoted strings, double-quoted strings, whitespace-delimited words, and optionally comments.

Copyright © 2008-2010 JBoss, a division of Red Hat. All Rights Reserved.