public final class FastCharStream extends java.lang.Object implements CharStream
Note that
this does not do line-number counting, but instead keeps track of the
character position of the token in the input, as required by Lucene's OffsetAttribute
API.
Modifier and Type | Field and Description |
---|---|
(package private) char[] |
buffer |
(package private) int |
bufferLength |
(package private) int |
bufferPosition |
(package private) int |
bufferStart |
(package private) java.io.Reader |
input |
(package private) int |
tokenStart |
Constructor and Description |
---|
FastCharStream(java.io.Reader r)
Constructs from a Reader.
|
Modifier and Type | Method and Description |
---|---|
void |
backup(int amount)
Backs up the input stream by amount steps.
|
char |
BeginToken()
Returns the next character that marks the beginning of the next token.
|
void |
Done()
The lexer calls this function to indicate that it is done with the stream
and hence implementations can free any resources held by this class.
|
int |
getBeginColumn()
Returns the column number of the first character for current token (being
matched after the last call to BeginTOken).
|
int |
getBeginLine()
Returns the line number of the first character for current token (being
matched after the last call to BeginTOken).
|
int |
getColumn() |
int |
getEndColumn()
Returns the column number of the last character for current token (being
matched after the last call to BeginTOken).
|
int |
getEndLine()
Returns the line number of the last character for current token (being
matched after the last call to BeginTOken).
|
java.lang.String |
GetImage()
Returns a string made up of characters from the marked token beginning
to the current buffer position.
|
int |
getLine() |
char[] |
GetSuffix(int len)
Returns an array of characters that make up the suffix of length 'len' for
the currently matched token.
|
char |
readChar()
Returns the next character from the selected input.
|
private void |
refill() |
char[] buffer
int bufferLength
int bufferPosition
int tokenStart
int bufferStart
java.io.Reader input
public final char readChar() throws java.io.IOException
CharStream
readChar
in interface CharStream
java.io.IOException
private final void refill() throws java.io.IOException
java.io.IOException
public final char BeginToken() throws java.io.IOException
CharStream
BeginToken
in interface CharStream
java.io.IOException
public final void backup(int amount)
CharStream
backup
in interface CharStream
public final java.lang.String GetImage()
CharStream
GetImage
in interface CharStream
public final char[] GetSuffix(int len)
CharStream
GetSuffix
in interface CharStream
public final void Done()
CharStream
Done
in interface CharStream
public final int getColumn()
getColumn
in interface CharStream
public final int getLine()
getLine
in interface CharStream
public final int getEndColumn()
CharStream
getEndColumn
in interface CharStream
public final int getEndLine()
CharStream
getEndLine
in interface CharStream
public final int getBeginColumn()
CharStream
getBeginColumn
in interface CharStream
public final int getBeginLine()
CharStream
getBeginLine
in interface CharStream