A WhitespaceTokenizer is a tokenizer that divides text at whitespace.
Adjacent sequences of non-Whitespace characters form tokens.
Namespace: Lucene.Net.AnalysisAssembly: Lucene.Net (in Lucene.Net.dll) Version: 2.9.4.1
Syntax
C# |
---|
public class WhitespaceTokenizer : CharTokenizer |
Visual Basic |
---|
Public Class WhitespaceTokenizer _ Inherits CharTokenizer |
Visual C++ |
---|
public ref class WhitespaceTokenizer : public CharTokenizer |
Inheritance Hierarchy
System..::..Object
Lucene.Net.Util..::..AttributeSource
Lucene.Net.Analysis..::..TokenStream
Lucene.Net.Analysis..::..Tokenizer
Lucene.Net.Analysis..::..CharTokenizer
Lucene.Net.Analysis..::..WhitespaceTokenizer
Lucene.Net.Util..::..AttributeSource
Lucene.Net.Analysis..::..TokenStream
Lucene.Net.Analysis..::..Tokenizer
Lucene.Net.Analysis..::..CharTokenizer
Lucene.Net.Analysis..::..WhitespaceTokenizer