Name
StreamTokenizer
Synopsis
This class performs lexical
analysis of a specified input stream and breaks the input into
tokens. It can be extremely useful when writing simple parsers.
nextToken(
) returns the next token in the stream; this is either one
of the constants defined by the class (which represent end-of-file,
end-of-line, a parsed floating-point number, and a parsed word) or a
character value. pushBack( ) pushes the token back
onto the stream, so that it is returned by the next call to
nextToken( ). The public variables
sval and nval contain the
string and numeric values (if applicable) of the most recently read
token. They are applicable when the returned token is
TT_WORD or TT_NUMBER.
lineno( ) returns the current line number.
The remaining methods allow you to specify how tokens are recognized.
wordChars(
) specifies a range of
characters that should be
treated as parts of words.
whitespaceChars(
) specifies a range of characters that serve to delimit
tokens. ordinaryChars(
)
and ordinaryChar(
) specify characters that are never part of tokens and
should be returned as-is. resetSyntax(
)
makes all characters
ordinary. eolIsSignificant(
)
specifies whether end-of-line is significant.
If so, the TT_EOL constant is returned for
end-of-lines; otherwise, they are treated as whitespace.
commentChar( )
specifies a character that begins a
comment that lasts until the end of the
line. No characters in the comment are returned.
slashStarComments(
)
and
slashSlashComments( ...
Get Java in a Nutshell, 5th Edition now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
