public final class BulgarianAnalyzer extends StopwordAnalyzerBase
Analyzer
for Bulgarian.
This analyzer implements light-stemming as specified by: Searching Strategies for the Bulgarian Language http://members.unine.ch/jacques.savoy/Papers/BUIR.pdf
Modifier and Type | Class and Description |
---|---|
private static class |
BulgarianAnalyzer.DefaultSetHolder
Atomically loads the DEFAULT_STOP_SET in a lazy fashion once the outer
class accesses the static final set the first time.;
|
Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents
Modifier and Type | Field and Description |
---|---|
static java.lang.String |
DEFAULT_STOPWORD_FILE
File containing default Bulgarian stopwords.
|
private CharArraySet |
stemExclusionSet |
stopwords
GLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY
Constructor and Description |
---|
BulgarianAnalyzer()
Builds an analyzer with the default stop words:
DEFAULT_STOPWORD_FILE . |
BulgarianAnalyzer(CharArraySet stopwords)
Builds an analyzer with the given stop words.
|
BulgarianAnalyzer(CharArraySet stopwords,
CharArraySet stemExclusionSet)
Builds an analyzer with the given stop words and a stem exclusion set.
|
Modifier and Type | Method and Description |
---|---|
Analyzer.TokenStreamComponents |
createComponents(java.lang.String fieldName)
Creates a
Analyzer.TokenStreamComponents
which tokenizes all the text in the provided Reader . |
static CharArraySet |
getDefaultStopSet()
Returns an unmodifiable instance of the default stop-words set.
|
protected TokenStream |
normalize(java.lang.String fieldName,
TokenStream in)
Wrap the given
TokenStream in order to apply normalization filters. |
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet
attributeFactory, close, getOffsetGap, getPositionIncrementGap, getReuseStrategy, getVersion, initReader, initReaderForNormalization, normalize, setVersion, tokenStream, tokenStream
public static final java.lang.String DEFAULT_STOPWORD_FILE
private final CharArraySet stemExclusionSet
public BulgarianAnalyzer()
DEFAULT_STOPWORD_FILE
.public BulgarianAnalyzer(CharArraySet stopwords)
public BulgarianAnalyzer(CharArraySet stopwords, CharArraySet stemExclusionSet)
SetKeywordMarkerFilter
before BulgarianStemFilter
.public static CharArraySet getDefaultStopSet()
public Analyzer.TokenStreamComponents createComponents(java.lang.String fieldName)
Analyzer.TokenStreamComponents
which tokenizes all the text in the provided Reader
.createComponents
in class Analyzer
fieldName
- the name of the fields content passed to the
Analyzer.TokenStreamComponents
sink as a readerAnalyzer.TokenStreamComponents
built from an StandardTokenizer
filtered with
LowerCaseFilter
, StopFilter
, SetKeywordMarkerFilter
if a stem exclusion set is
provided and BulgarianStemFilter
.protected TokenStream normalize(java.lang.String fieldName, TokenStream in)
Analyzer
TokenStream
in order to apply normalization filters.
The default implementation returns the TokenStream
as-is. This is
used by Analyzer.normalize(String, String)
.