public final class PolishAnalyzer extends StopwordAnalyzerBase
Analyzer
for Polish.Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents
Modifier and Type | Field and Description |
---|---|
static String |
DEFAULT_STEMMER_FILE
File containing default Polish stemmer table.
|
static String |
DEFAULT_STOPWORD_FILE
File containing default Polish stopwords.
|
stopwords
GLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY
Constructor and Description |
---|
PolishAnalyzer()
Builds an analyzer with the default stop words:
DEFAULT_STOPWORD_FILE . |
PolishAnalyzer(CharArraySet stopwords)
Builds an analyzer with the given stop words.
|
PolishAnalyzer(CharArraySet stopwords,
CharArraySet stemExclusionSet)
Builds an analyzer with the given stop words.
|
Modifier and Type | Method and Description |
---|---|
protected Analyzer.TokenStreamComponents |
createComponents(String fieldName)
Creates a
Analyzer.TokenStreamComponents
which tokenizes all the text in the provided Reader . |
static CharArraySet |
getDefaultStopSet()
Returns an unmodifiable instance of the default stop words set.
|
static Trie |
getDefaultTable()
Returns an unmodifiable instance of the default stemmer table.
|
protected TokenStream |
normalize(String fieldName,
TokenStream in) |
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet
attributeFactory, close, getOffsetGap, getPositionIncrementGap, getReuseStrategy, getVersion, initReader, initReaderForNormalization, normalize, setVersion, tokenStream, tokenStream
public static final String DEFAULT_STOPWORD_FILE
public static final String DEFAULT_STEMMER_FILE
public PolishAnalyzer()
DEFAULT_STOPWORD_FILE
.public PolishAnalyzer(CharArraySet stopwords)
stopwords
- a stopword setpublic PolishAnalyzer(CharArraySet stopwords, CharArraySet stemExclusionSet)
SetKeywordMarkerFilter
before
stemming.stopwords
- a stopword setstemExclusionSet
- a set of terms not to be stemmedpublic static CharArraySet getDefaultStopSet()
public static Trie getDefaultTable()
protected Analyzer.TokenStreamComponents createComponents(String fieldName)
Analyzer.TokenStreamComponents
which tokenizes all the text in the provided Reader
.createComponents
in class Analyzer
Analyzer.TokenStreamComponents
built from an StandardTokenizer
filtered with
StandardFilter
, LowerCaseFilter
, StopFilter
, SetKeywordMarkerFilter
if a stem exclusion set is
provided and StempelFilter
.protected TokenStream normalize(String fieldName, TokenStream in)
Copyright © 2000-2017 Apache Software Foundation. All Rights Reserved.