public final class SimpleTokenizer extends AbstractTokenizer
Mandatory parameters
Type | Name | Description |
---|---|---|
String | opennlp.uima.SentenceType | The full name of the sentence type |
String | opennlp.uima.TokenType | The full name of the token type |
context, logger, name, sentenceType, tokenType
Constructor and Description |
---|
SimpleTokenizer()
Initializes the current instance.
|
Modifier and Type | Method and Description |
---|---|
protected Span[] |
tokenize(org.apache.uima.cas.CAS cas,
org.apache.uima.cas.text.AnnotationFS sentence) |
initialize, postProcessAnnotations, process, typeSystemInit
getRequiredCasInterface, process
getCasInstancesRequired, hasNext, next
public SimpleTokenizer()
AbstractTokenizer.initialize(UimaContext)
to initialize
this instance. Not use the constructor.protected Span[] tokenize(org.apache.uima.cas.CAS cas, org.apache.uima.cas.text.AnnotationFS sentence)
tokenize
in class AbstractTokenizer
Copyright © 2016 The Apache Software Foundation. All rights reserved.