public class SimpleSpanFragmenter extends java.lang.Object implements Fragmenter
Fragmenter
implementation which breaks text up into same-size
fragments but does not split up Spans
. This is a simple sample class.Modifier and Type | Field and Description |
---|---|
private int |
currentNumFrags |
private static int |
DEFAULT_FRAGMENT_SIZE |
private int |
fragmentSize |
private OffsetAttribute |
offsetAtt |
private PositionIncrementAttribute |
posIncAtt |
private int |
position |
private QueryScorer |
queryScorer |
private CharTermAttribute |
termAtt |
private int |
textSize |
private int |
waitForPos |
Constructor and Description |
---|
SimpleSpanFragmenter(QueryScorer queryScorer) |
SimpleSpanFragmenter(QueryScorer queryScorer,
int fragmentSize) |
Modifier and Type | Method and Description |
---|---|
boolean |
isNewFragment()
Test to see if this token from the stream should be held in a new
TextFragment.
|
void |
start(java.lang.String originalText,
TokenStream tokenStream)
Initializes the Fragmenter.
|
private static final int DEFAULT_FRAGMENT_SIZE
private int fragmentSize
private int currentNumFrags
private int position
private QueryScorer queryScorer
private int waitForPos
private int textSize
private CharTermAttribute termAtt
private PositionIncrementAttribute posIncAtt
private OffsetAttribute offsetAtt
public SimpleSpanFragmenter(QueryScorer queryScorer)
queryScorer
- QueryScorer that was used to score hitspublic SimpleSpanFragmenter(QueryScorer queryScorer, int fragmentSize)
queryScorer
- QueryScorer that was used to score hitsfragmentSize
- size in chars of each fragmentpublic boolean isNewFragment()
Fragmenter
isNewFragment
in interface Fragmenter
public void start(java.lang.String originalText, TokenStream tokenStream)
Fragmenter
Fragmenter.isNewFragment()
.start
in interface Fragmenter
originalText
- the original source texttokenStream
- the TokenStream
to be fragmented