Public Member Functions
zorba::TokenizerProvider Class Reference

A TokenizerProvider provides a Tokenizer for a given language. More...

#include <zorba/tokenizer.h>

List of all members.

Public Member Functions

virtual Tokenizer::ptr getTokenizer (locale::iso639_1::type lang, Tokenizer::Numbers &numbers) const =0
 Creates a new Tokenizer.
virtual ~TokenizerProvider ()

Detailed Description

A TokenizerProvider provides a Tokenizer for a given language.

Definition at line 206 of file tokenizer.h.


Constructor & Destructor Documentation

virtual zorba::TokenizerProvider::~TokenizerProvider ( ) [virtual]

Member Function Documentation

virtual Tokenizer::ptr zorba::TokenizerProvider::getTokenizer ( locale::iso639_1::type  lang,
Tokenizer::Numbers numbers 
) const [pure virtual]

Creates a new Tokenizer.

Parameters:
langThe language of the text that the tokenizer will tokenize.
numbersThe Numbers to use.
Returns:
Returns said Tokenizer.

The documentation for this class was generated from the following file:
blog comments powered by Disqus