public static final class Analyzer.TokenStreamComponents
extends java.lang.Object
Reader
Consumer
and the outer end (sink), an
instance of TokenFilter
which also serves as the
TokenStream
returned by
Analyzer.tokenStream(String, Reader)
.Modifier and Type | Field and Description |
---|---|
(package private) ReusableStringReader |
reusableStringReader
Internal cache only used by
Analyzer.tokenStream(String, String) . |
protected TokenStream |
sink
Sink tokenstream, such as the outer tokenfilter decorating
the chain.
|
protected java.util.function.Consumer<java.io.Reader> |
source
Original source of the tokens.
|
Constructor and Description |
---|
TokenStreamComponents(java.util.function.Consumer<java.io.Reader> source,
TokenStream result)
Creates a new
Analyzer.TokenStreamComponents instance. |
TokenStreamComponents(Tokenizer tokenizer)
Creates a new
Analyzer.TokenStreamComponents from a Tokenizer |
TokenStreamComponents(Tokenizer tokenizer,
TokenStream result)
Creates a new
Analyzer.TokenStreamComponents instance |
Modifier and Type | Method and Description |
---|---|
java.util.function.Consumer<java.io.Reader> |
getSource()
Returns the component's source
|
TokenStream |
getTokenStream()
Returns the sink
TokenStream |
private void |
setReader(java.io.Reader reader)
Resets the encapsulated components with the given reader.
|
protected final java.util.function.Consumer<java.io.Reader> source
protected final TokenStream sink
transient ReusableStringReader reusableStringReader
Analyzer.tokenStream(String, String)
.public TokenStreamComponents(java.util.function.Consumer<java.io.Reader> source, TokenStream result)
Analyzer.TokenStreamComponents
instance.source
- the source to set the reader onresult
- the analyzer's resulting token streampublic TokenStreamComponents(Tokenizer tokenizer, TokenStream result)
Analyzer.TokenStreamComponents
instancetokenizer
- the analyzer's Tokenizerresult
- the analyzer's resulting token streampublic TokenStreamComponents(Tokenizer tokenizer)
Analyzer.TokenStreamComponents
from a Tokenizerprivate void setReader(java.io.Reader reader)
reader
- a reader to reset the source componentpublic TokenStream getTokenStream()
TokenStream
TokenStream
public java.util.function.Consumer<java.io.Reader> getSource()