org.apache.lucene.analysis.cjk

Class CJKAnalyzer

public class CJKAnalyzer extends Analyzer

Filters CJKTokenizer with StopFilter.

Author: Che, Dong

Field Summary
static String[]STOP_WORDS
An array containing some common English words that are not usually useful for searching and some double-byte interpunctions.
Constructor Summary
CJKAnalyzer()
Builds an analyzer which removes words in {@link #STOP_WORDS}.
CJKAnalyzer(String[] stopWords)
Builds an analyzer which removes words in the provided array.
Method Summary
TokenStreamtokenStream(String fieldName, Reader reader)
get token stream from input

Field Detail

STOP_WORDS

public static final String[] STOP_WORDS
An array containing some common English words that are not usually useful for searching and some double-byte interpunctions.

Constructor Detail

CJKAnalyzer

public CJKAnalyzer()
Builds an analyzer which removes words in {@link #STOP_WORDS}.

CJKAnalyzer

public CJKAnalyzer(String[] stopWords)
Builds an analyzer which removes words in the provided array.

Parameters: stopWords stop word array

Method Detail

tokenStream

public final TokenStream tokenStream(String fieldName, Reader reader)
get token stream from input

Parameters: fieldName lucene field name reader input reader

Returns: TokenStream

Copyright © 2000-2007 Apache Software Foundation. All Rights Reserved.