Lucene++ - a full-featured, c++ search engine
API Documentation
Go to the documentation of this file.
7 #ifndef CHARTOKENIZER_H
8 #define CHARTOKENIZER_H
38 virtual bool incrementToken();
46 virtual bool isTokenChar(
wchar_t c) = 0;
50 virtual wchar_t normalize(
wchar_t c);
clucene.sourceforge.net