public static class DdlTokenStream.DdlTokenizer extends Object implements TokenStream.Tokenizer
Modifier and Type | Field and Description |
---|---|
static int |
COMMENT
The
token type for tokens that consist of all the characters
between "/*" and "*/", between "//" and the next line terminator (e.g., '\n', '\r' or "\r\n"), or between "--" and
the next line terminator (e.g., '\n', '\r' or "\r\n"). |
static int |
DECIMAL
The
token type for tokens that consist of an individual '.' |
static int |
DOUBLE_QUOTED_STRING
The
token type for tokens that consist of all the characters
within double-quotes. |
static int |
KEYWORD
The
token type for tokens that represent key words or
reserved words for a given DDL dialect. |
static String |
PARSER_ID |
static int |
SINGLE_QUOTED_STRING
The
token type for tokens that consist of all the characters
within single-quotes. |
static int |
STATEMENT_KEY
The
token type for tokens that represent the start of a DDL
statement. |
static int |
SYMBOL
The
token type for tokens that consist of an individual
"symbol" character. |
static int |
WORD
The
token type for tokens that represent an unquoted string
containing a character sequence made up of non-whitespace and non-symbol characters. |
Constructor and Description |
---|
DdlTokenizer(boolean useComments) |
Modifier and Type | Method and Description |
---|---|
boolean |
includeComments() |
void |
tokenize(TokenStream.CharacterStream input,
TokenStream.Tokens tokens)
Process the supplied characters and construct the appropriate
TokenStream.Token objects. |
public static final String PARSER_ID
public static final int WORD
token type
for tokens that represent an unquoted string
containing a character sequence made up of non-whitespace and non-symbol characters.public static final int SYMBOL
token type
for tokens that consist of an individual
"symbol" character. The set of characters includes: -(){}*,;+%?$[]!<>|=:
public static final int DECIMAL
token type
for tokens that consist of an individual '.'
character.public static final int SINGLE_QUOTED_STRING
token type
for tokens that consist of all the characters
within single-quotes. Single quote characters are included if they are preceded (escaped) by a '\' character.public static final int DOUBLE_QUOTED_STRING
token type
for tokens that consist of all the characters
within double-quotes. Double quote characters are included if they are preceded (escaped) by a '\' character.public static final int COMMENT
token type
for tokens that consist of all the characters
between "/*" and "*/", between "//" and the next line terminator (e.g., '\n', '\r' or "\r\n"), or between "--" and
the next line terminator (e.g., '\n', '\r' or "\r\n").public static final int KEYWORD
token type
for tokens that represent key words or
reserved words for a given DDL dialect.
Examples would be: "CREATE", "TABLE", "ALTER", "SCHEMA", "DROP", etc...
seeDdlConstants
for the default SQL 92 representations.public static final int STATEMENT_KEY
token type
for tokens that represent the start of a DDL
statement.
Examples would be: {"CREATE", "TABLE"} {"CREATE", "OR", "REPLACE", "VIEW"}
seeDdlConstants
for the default SQL 92 representations.public boolean includeComments()
public void tokenize(TokenStream.CharacterStream input, TokenStream.Tokens tokens) throws ParsingException
TokenStream.Token
objects.tokenize
in interface TokenStream.Tokenizer
input
- the character input stream; never nulltokens
- the factory for TokenStream.Token
objects, which records the order in which the tokens are createdParsingException
- if there is an error while processing the character stream (e.g., a quote is not closed, etc.)TokenStream.Tokenizer.tokenize(TokenStream.CharacterStream, TokenStream.Tokens)
Copyright © 2008–2016 JBoss, a division of Red Hat. All rights reserved.