/[Apache-SVN]
ViewVC logotype

Revision 900196

Jump to revision: Previous Next
Author: rmuir
Date: Sun Jan 17 19:25:57 2010 UTC (14 years, 8 months ago)
Changed paths: 11
Log Message: 
LUCENE-2207: CJKTokenizer generates tokens with incorrect offsets
LUCENE-2219: Chinese, SmartChinese, Wikipedia tokenizers generate incorrect offsets, test end() in BaseTokenStreamTestCase

Changed paths

Path Details
Directorylucene/java/trunk/CHANGES.txt modified , text changed
Directorylucene/java/trunk/contrib/CHANGES.txt modified , text changed
Directorylucene/java/trunk/contrib/analyzers/common/src/java/org/apache/lucene/analysis/cjk/CJKTokenizer.java modified , text changed
Directorylucene/java/trunk/contrib/analyzers/common/src/java/org/apache/lucene/analysis/cn/ChineseTokenizer.java modified , text changed
Directorylucene/java/trunk/contrib/analyzers/common/src/test/org/apache/lucene/analysis/cjk/TestCJKTokenizer.java modified , text changed
Directorylucene/java/trunk/contrib/analyzers/common/src/test/org/apache/lucene/analysis/ngram/EdgeNGramTokenizerTest.java modified , text changed
Directorylucene/java/trunk/contrib/analyzers/common/src/test/org/apache/lucene/analysis/ngram/NGramTokenizerTest.java modified , text changed
Directorylucene/java/trunk/contrib/analyzers/smartcn/src/java/org/apache/lucene/analysis/cn/smart/SentenceTokenizer.java modified , text changed
Directorylucene/java/trunk/contrib/wikipedia/src/java/org/apache/lucene/wikipedia/analysis/WikipediaTokenizer.java modified , text changed
Directorylucene/java/trunk/contrib/wikipedia/src/test/org/apache/lucene/wikipedia/analysis/WikipediaTokenizerTest.java modified , text changed
Directorylucene/java/trunk/src/test/org/apache/lucene/analysis/BaseTokenStreamTestCase.java modified , text changed
infrastructure at apache.org
 ViewVC Help
Powered by ViewVC 1.1.26