public class DictionaryCompoundWordTokenFilterFactory extends TokenFilterFactory implements ResourceLoaderAware
DictionaryCompoundWordTokenFilter
.
<fieldType name="text_dictcomp" class="solr.TextField" positionIncrementGap="100"> <analyzer> <tokenizer class="solr.WhitespaceTokenizerFactory"/> <filter class="solr.DictionaryCompoundWordTokenFilterFactory" dictionary="dictionary.txt" minWordSize="5" minSubwordSize="2" maxSubwordSize="15" onlyLongestMatch="true"/> </analyzer> </fieldType>
Modifier and Type | Field and Description |
---|---|
private java.lang.String |
dictFile |
private CharArraySet |
dictionary |
private int |
maxSubwordSize |
private int |
minSubwordSize |
private int |
minWordSize |
private boolean |
onlyLongestMatch |
LUCENE_MATCH_VERSION_PARAM, luceneMatchVersion
Constructor and Description |
---|
DictionaryCompoundWordTokenFilterFactory(java.util.Map<java.lang.String,java.lang.String> args)
Creates a new DictionaryCompoundWordTokenFilterFactory
|
Modifier and Type | Method and Description |
---|---|
TokenStream |
create(TokenStream input)
Transform the specified input TokenStream
|
void |
inform(ResourceLoader loader)
Initializes this component with the provided ResourceLoader
(used for loading classes, files, etc).
|
availableTokenFilters, forName, lookupClass, normalize, reloadTokenFilters
get, get, get, get, get, getBoolean, getChar, getClassArg, getFloat, getInt, getLines, getLuceneMatchVersion, getOriginalArgs, getPattern, getSet, getSnowballWordSet, getWordSet, isExplicitLuceneMatchVersion, require, require, require, requireBoolean, requireChar, requireFloat, requireInt, setExplicitLuceneMatchVersion, splitAt, splitFileNames
private CharArraySet dictionary
private final java.lang.String dictFile
private final int minWordSize
private final int minSubwordSize
private final int maxSubwordSize
private final boolean onlyLongestMatch
public DictionaryCompoundWordTokenFilterFactory(java.util.Map<java.lang.String,java.lang.String> args)
public void inform(ResourceLoader loader) throws java.io.IOException
ResourceLoaderAware
inform
in interface ResourceLoaderAware
java.io.IOException
public TokenStream create(TokenStream input)
TokenFilterFactory
create
in class TokenFilterFactory