See: Description
Class | Description |
---|---|
WikipediaTokenizer |
Extension of StandardTokenizer that is aware of Wikipedia syntax.
|
WikipediaTokenizerFactory |
Factory for
WikipediaTokenizer . |
WikipediaTokenizerImpl |
JFlex-generated tokenizer that is aware of Wikipedia syntax.
|