public final class LimitTokenCountAnalyzer extends AnalyzerWrapper
IndexWriter
.LimitTokenCountFilter
Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents
Modifier and Type | Field and Description |
---|---|
private boolean |
consumeAllTokens |
private Analyzer |
delegate |
private int |
maxTokenCount |
GLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY
Constructor and Description |
---|
LimitTokenCountAnalyzer(Analyzer delegate,
int maxTokenCount)
Build an analyzer that limits the maximum number of tokens per field.
|
LimitTokenCountAnalyzer(Analyzer delegate,
int maxTokenCount,
boolean consumeAllTokens)
Build an analyzer that limits the maximum number of tokens per field.
|
Modifier and Type | Method and Description |
---|---|
protected Analyzer |
getWrappedAnalyzer(java.lang.String fieldName)
Retrieves the wrapped Analyzer appropriate for analyzing the field with
the given name
|
java.lang.String |
toString() |
protected Analyzer.TokenStreamComponents |
wrapComponents(java.lang.String fieldName,
Analyzer.TokenStreamComponents components)
Wraps / alters the given TokenStreamComponents, taken from the wrapped
Analyzer, to form new components.
|
attributeFactory, createComponents, getOffsetGap, getPositionIncrementGap, initReader, initReaderForNormalization, normalize, wrapReader, wrapReaderForNormalization, wrapTokenStreamForNormalization
close, getReuseStrategy, getVersion, normalize, setVersion, tokenStream, tokenStream
private final Analyzer delegate
private final int maxTokenCount
private final boolean consumeAllTokens
public LimitTokenCountAnalyzer(Analyzer delegate, int maxTokenCount)
public LimitTokenCountAnalyzer(Analyzer delegate, int maxTokenCount, boolean consumeAllTokens)
delegate
- the analyzer to wrapmaxTokenCount
- max number of tokens to produceconsumeAllTokens
- whether all tokens from the delegate should be consumed even if maxTokenCount is reached.protected Analyzer getWrappedAnalyzer(java.lang.String fieldName)
AnalyzerWrapper
getWrappedAnalyzer
in class AnalyzerWrapper
fieldName
- Name of the field which is to be analyzedprotected Analyzer.TokenStreamComponents wrapComponents(java.lang.String fieldName, Analyzer.TokenStreamComponents components)
AnalyzerWrapper
wrapComponents
in class AnalyzerWrapper
fieldName
- Name of the field which is to be analyzedcomponents
- TokenStreamComponents taken from the wrapped Analyzerpublic java.lang.String toString()
toString
in class java.lang.Object