/[Apache-SVN]
ViewVC logotype

Revision 1311072

Jump to revision: Previous Next
Author: mikemccand
Date: Sun Apr 8 19:17:17 2012 UTC (12 years, 7 months ago)
Changed paths: 8
Log Message: 
LUCENE-3940: fix Kuromoji to not produce invalid token graph due to UNK with punctuation being decompounded

Changed paths

Path Details
Directorylucene/dev/trunk/lucene/test-framework/src/java/org/apache/lucene/analysis/BaseTokenStreamTestCase.java modified , text changed
Directorylucene/dev/trunk/lucene/test-framework/src/java/org/apache/lucene/analysis/LookaheadTokenFilter.java modified , text changed
Directorylucene/dev/trunk/lucene/test-framework/src/java/org/apache/lucene/analysis/MockCharFilter.java modified , text changed
Directorylucene/dev/trunk/lucene/test-framework/src/java/org/apache/lucene/analysis/MockHoleInjectingTokenFilter.java modified , text changed
Directorylucene/dev/trunk/modules/analysis/kuromoji/src/java/org/apache/lucene/analysis/ja/JapaneseTokenizer.java modified , text changed
Directorylucene/dev/trunk/modules/analysis/kuromoji/src/java/org/apache/lucene/analysis/ja/Token.java modified , text changed
Directorylucene/dev/trunk/modules/analysis/kuromoji/src/test/org/apache/lucene/analysis/ja/TestJapaneseAnalyzer.java modified , text changed
Directorylucene/dev/trunk/modules/analysis/kuromoji/src/test/org/apache/lucene/analysis/ja/TestJapaneseTokenizer.java modified , text changed
infrastructure at apache.org
 ViewVC Help
Powered by ViewVC 1.1.26