/[Apache-SVN]
ViewVC logotype

Revision 1714355


Jump to revision: Previous Next
Author: uschindler
Date: Sat Nov 14 19:31:41 2015 UTC (8 years, 5 months ago)
Changed paths: 17
Log Message:
Merged revision(s) 1714354 from lucene/dev/trunk:
LUCENE-6874: Add a new UnicodeWhitespaceTokenizer to analysis/common that uses Unicode character properties extracted from ICU4J to tokenize text on whitespace

Changed paths

Path Details
Directorylucene/dev/branches/branch_5x/ modified , props changed
Directorylucene/dev/branches/branch_5x/lucene/ modified , props changed
Directorylucene/dev/branches/branch_5x/lucene/CHANGES.txt modified , text changed , props changed
Directorylucene/dev/branches/branch_5x/lucene/analysis/ modified , props changed
Directorylucene/dev/branches/branch_5x/lucene/analysis/common/build.xml modified , text changed
Directorylucene/dev/branches/branch_5x/lucene/analysis/common/src/java/org/apache/lucene/analysis/core/UnicodeWhitespaceAnalyzer.java
(Copied from lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/core/UnicodeWhitespaceAnalyzer.java, r1714354)
added
Directorylucene/dev/branches/branch_5x/lucene/analysis/common/src/java/org/apache/lucene/analysis/core/UnicodeWhitespaceTokenizer.java
(Copied from lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/core/UnicodeWhitespaceTokenizer.java, r1714354)
added
Directorylucene/dev/branches/branch_5x/lucene/analysis/common/src/java/org/apache/lucene/analysis/core/WhitespaceTokenizer.java modified , text changed
Directorylucene/dev/branches/branch_5x/lucene/analysis/common/src/java/org/apache/lucene/analysis/core/WhitespaceTokenizerFactory.java modified , text changed
Directorylucene/dev/branches/branch_5x/lucene/analysis/common/src/java/org/apache/lucene/analysis/util/UnicodeProps.java
(Copied from lucene/dev/trunk/lucene/analysis/common/src/java/org/apache/lucene/analysis/util/UnicodeProps.java, r1714354)
added
Directorylucene/dev/branches/branch_5x/lucene/analysis/common/src/test/org/apache/lucene/analysis/core/TestAllAnalyzersHaveFactories.java modified , text changed
Directorylucene/dev/branches/branch_5x/lucene/analysis/common/src/test/org/apache/lucene/analysis/core/TestAnalyzers.java modified , text changed
Directorylucene/dev/branches/branch_5x/lucene/analysis/common/src/test/org/apache/lucene/analysis/core/TestUnicodeWhitespaceTokenizer.java
(Copied from lucene/dev/trunk/lucene/analysis/common/src/test/org/apache/lucene/analysis/core/TestUnicodeWhitespaceTokenizer.java, r1714354)
added
Directorylucene/dev/branches/branch_5x/lucene/analysis/common/src/tools/groovy/
(Copied from lucene/dev/trunk/lucene/analysis/common/src/tools/groovy, r1714354)
added
Directorylucene/dev/branches/branch_5x/lucene/benchmark/ modified , props changed
Directorylucene/dev/branches/branch_5x/lucene/benchmark/conf/wstok.alg
(Copied from lucene/dev/trunk/lucene/benchmark/conf/wstok.alg, r1714354)
added
Directorylucene/dev/branches/branch_5x/lucene/benchmark/src/java/org/apache/lucene/benchmark/utils/ExtractReuters.java modified , text changed

infrastructure at apache.org
ViewVC Help
Powered by ViewVC 1.1.26