Lucene.Net
3.0.3
Lucene.Net is a .NET port of the Java Lucene Indexing Library
|
Filters CJKTokenizer with StopFilter. More...
Inherits Lucene.Net.Analysis.Analyzer.
Public Member Functions | |
CJKAnalyzer (Version matchVersion) | |
CJKAnalyzer (Version matchVersion, ISet< string > stopWords) | |
CJKAnalyzer (Version matchVersion, params string[] stopWords) | |
Builds an analyzer which removes words in the provided array. | |
override sealed TokenStream | TokenStream (String fieldName, TextReader reader) |
get token stream from input | |
override sealed TokenStream | ReusableTokenStream (String fieldName, TextReader reader) |
Public Member Functions inherited from Lucene.Net.Analysis.Analyzer | |
abstract TokenStream | TokenStream (String fieldName, System.IO.TextReader reader) |
Creates a TokenStream which tokenizes all the text in the provided Reader. Must be able to handle null field name for backward compatibility. | |
virtual TokenStream | ReusableTokenStream (String fieldName, System.IO.TextReader reader) |
Creates a TokenStream that is allowed to be re-used from the previous time that the same thread called this method. Callers that do not need to use more than one TokenStream at the same time from this analyzer should use this method for better performance. | |
virtual int | GetPositionIncrementGap (String fieldName) |
Invoked before indexing a Fieldable instance if terms have already been added to that field. This allows custom analyzers to place an automatic position increment gap between Fieldable instances using the same field name. The default value position increment gap is 0. With a 0 position increment gap and the typical default token position increment of 1, all terms in a field, including across Fieldable instances, are in successive positions, allowing exact PhraseQuery matches, for instance, across Fieldable instance boundaries. | |
virtual int | GetOffsetGap (IFieldable field) |
Just like GetPositionIncrementGap, except for Token offsets instead. By default this returns 1 for tokenized fields and, as if the fields were joined with an extra space character, and 0 for un-tokenized fields. This method is only called if the field produced at least one token for indexing. | |
void | Close () |
Frees persistent resources used by this Analyzer | |
virtual void | Dispose () |
Static Public Member Functions | |
static ISet< string > | GetDefaultStopSet () |
Returns an unmodifiable instance of the default stop-words set. | |
Static Public Attributes | |
static String[] | STOP_WORDS |
An array containing some common English words that are not usually useful for searching. and some double-byte interpunctions..... | |
Additional Inherited Members | |
Protected Member Functions inherited from Lucene.Net.Analysis.Analyzer | |
virtual void | Dispose (bool disposing) |
Filters CJKTokenizer with StopFilter.
<author>Che, Dong</author>
Definition at line 36 of file CJKAnalyzer.cs.
Lucene.Net.Analysis.CJK.CJKAnalyzer.CJKAnalyzer | ( | Version | matchVersion | ) |
Definition at line 84 of file CJKAnalyzer.cs.
Lucene.Net.Analysis.CJK.CJKAnalyzer.CJKAnalyzer | ( | Version | matchVersion, |
ISet< string > | stopWords | ||
) |
Definition at line 90 of file CJKAnalyzer.cs.
Lucene.Net.Analysis.CJK.CJKAnalyzer.CJKAnalyzer | ( | Version | matchVersion, |
params string[] | stopWords | ||
) |
Builds an analyzer which removes words in the provided array.
stopWords | stop word array |
Definition at line 100 of file CJKAnalyzer.cs.
|
static |
Returns an unmodifiable instance of the default stop-words set.
Definition at line 64 of file CJKAnalyzer.cs.
override sealed TokenStream Lucene.Net.Analysis.CJK.CJKAnalyzer.ReusableTokenStream | ( | String | fieldName, |
TextReader | reader | ||
) |
Definition at line 135 of file CJKAnalyzer.cs.
override sealed TokenStream Lucene.Net.Analysis.CJK.CJKAnalyzer.TokenStream | ( | String | fieldName, |
TextReader | reader | ||
) |
get token stream from input
fieldName | lucene field name |
reader | input reader |
Definition at line 114 of file CJKAnalyzer.cs.
|
static |
An array containing some common English words that are not usually useful for searching. and some double-byte interpunctions.....
Definition at line 46 of file CJKAnalyzer.cs.