![]() |
Overloaded. Initializes a new instance of the StandardTokenizer class. |
![]() | By default, closes the input Reader. |
![]() | Determines whether the specified Object is equal to the current Object. |
![]() | Serves as a hash function for a particular type. GetHashCode is suitable for use in hashing algorithms and data structures like a hash table. |
![]() | |
![]() | Gets the Type of the current instance. |
![]() | Prior to https://issues.apache.org/jira/browse/LUCENE-1068, StandardTokenizer mischaracterized as acronyms tokens like www.abc.com when they should have been labeled as hosts instead. |
![]() | Overloaded. |
![]() | Overloaded. Returns the next token in the stream, or null at EOS. @deprecated The returned Token is a "full private copy" (not re-used across calls to next()) but will be slower than calling {@link #Next(Token)} instead.. |
![]() | Overloaded. |
![]() | Set the max allowed token length. Any token longer than this is skipped. |
![]() | |
![]() | Returns a String that represents the current Object. |
![]() | Allows an Object to attempt to free resources and perform other cleanup operations before the Object is reclaimed by garbage collection. |
![]() | Creates a shallow copy of the current Object. |
![]() | The text source for this Tokenizer. |
StandardTokenizer Class | Lucene.Net.Analysis.Standard Namespace