Uses of Interface
org.modeshape.common.text.TokenStream.Tokenizer

Packages that use TokenStream.Tokenizer

org.modeshape.cnd	Compact Node Definition (CND) defines JCR node types, property definitions, and child node definitions in a concise and easy-to-read form.
org.modeshape.common.text	A set of utilities for working with text.
org.modeshape.graph.query.parse	This package defines the QueryParser interface, which defines a component that can parse a query represented in a specific language and produce the corresponding abstract query model representation.
org.modeshape.jcr.xpath	The components used to parse JCR XPath queries and translate them into equivalent JCR-SQL2 queries.
org.modeshape.sequencer.ddl	The classes that make up the DDL sequencer, which is capable of parsing the more important DDL statements from SQL-92, Oracle, Derby, and PostgreSQL, and constructing a graph structure containing a structured representation of these statements.

Uses of TokenStream.Tokenizer in org.modeshape.cnd

Classes in org.modeshape.cnd that implement TokenStream.Tokenizer

class

CndTokenizer A TokenStream.Tokenizer implementation that adheres to the CND format by ignoring whitespace while including tokens for individual symbols, the period ('.'), single-quoted strings, double-quoted strings, whitespace-delimited words, and optionally comments.

Uses of TokenStream.Tokenizer in org.modeshape.common.text

Classes in org.modeshape.common.text that implement TokenStream.Tokenizer

static class

TokenStream.BasicTokenizer A basic TokenStream.Tokenizer implementation that ignores whitespace but includes tokens for individual symbols, the period ('.'), single-quoted strings, double-quoted strings, whitespace-delimited words, and optionally comments.

Constructors in org.modeshape.common.text with parameters of type TokenStream.Tokenizer

TokenStream(String content, TokenStream.Tokenizer tokenizer, boolean caseSensitive)

Uses of TokenStream.Tokenizer in org.modeshape.graph.query.parse

Classes in org.modeshape.graph.query.parse that implement TokenStream.Tokenizer

static class	FullTextSearchParser.TermTokenizer A basic TokenStream.Tokenizer implementation that ignores whitespace but includes tokens for individual symbols, the period ('.'), single-quoted strings, double-quoted strings, whitespace-delimited words, and optionally comments.
static class	SqlQueryParser.SqlTokenizer A TokenStream.Tokenizer implementation that parses words, quoted phrases, comments, and symbols.

Uses of TokenStream.Tokenizer in org.modeshape.jcr.xpath

Classes in org.modeshape.jcr.xpath that implement TokenStream.Tokenizer

static class

XPathParser.XPathTokenizer A TokenStream.Tokenizer implementation that parses single- and double-quoted strings, symbols, words consisting of NCNames (as defined by the Namespaces in XML 1.0 specification), XPath comments,and other single-character tokens.

Uses of TokenStream.Tokenizer in org.modeshape.sequencer.ddl

Classes in org.modeshape.sequencer.ddl that implement TokenStream.Tokenizer

static class

DdlTokenStream.DdlTokenizer

Constructors in org.modeshape.sequencer.ddl with parameters of type TokenStream.Tokenizer

DdlTokenStream(String content, TokenStream.Tokenizer tokenizer, boolean caseSensitive)