public class ClassicFilter extends TokenFilter
ClassicTokenizer
.AttributeSource.State
Modifier and Type | Field and Description |
---|---|
private static java.lang.String |
ACRONYM_TYPE |
private static java.lang.String |
APOSTROPHE_TYPE |
private CharTermAttribute |
termAtt |
private TypeAttribute |
typeAtt |
input
DEFAULT_TOKEN_ATTRIBUTE_FACTORY
Constructor and Description |
---|
ClassicFilter(TokenStream in)
Construct filtering in.
|
Modifier and Type | Method and Description |
---|---|
boolean |
incrementToken()
Returns the next token in the stream, or null at EOS.
|
close, end, reset
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, endAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, removeAllAttributes, restoreState, toString
private static final java.lang.String APOSTROPHE_TYPE
private static final java.lang.String ACRONYM_TYPE
private final TypeAttribute typeAtt
private final CharTermAttribute termAtt
public ClassicFilter(TokenStream in)
public final boolean incrementToken() throws java.io.IOException
Removes 's from the end of words.
Removes dots from acronyms.
incrementToken
in class TokenStream
java.io.IOException