The methods of the SinkTokenizer class are listed below. For a complete list of SinkTokenizer class members, see the SinkTokenizer Members topic.
Add | Override this method to cache only certain tokens, or new tokens based on the old tokens. |
Close | |
Equals (inherited from Object) | Determines whether the specified Object is equal to the current Object. |
GetHashCode (inherited from Object) | Serves as a hash function for a particular type. GetHashCode is suitable for use in hashing algorithms and data structures like a hash table. |
GetTokens | Get the tokens in the internal List. WARNING: Adding tokens to this list requires the {@link #Reset()} method to be called in order for them to be made available. Also, this Tokenizer does nothing to protect against {@link java.util.ConcurrentModificationException}s in the case of adds happening while {@link #Next(Lucene.Net.Analysis.Token)} is being called. WARNING: Since this SinkTokenizer can be reset and the cached tokens made available again, do not modify them. Modify clones instead. |
GetType (inherited from Object) | Gets the Type of the current instance. |
Next | Overloaded. Returns the next token out of the list of cached tokens |
Next (inherited from TokenStream) | Overloaded. Returns the next token in the stream, or null at EOS. @deprecated The returned Token is a "full private copy" (not re-used across calls to next()) but will be slower than calling {@link #Next(Token)} instead.. |
Reset | Overloaded. Reset the internal data structures to the start at the front of the list of tokens. Should be called if tokens were added to the list after an invocation of {@link #Next(Token)} |
Reset (inherited from Tokenizer) | Overloaded. Expert: Reset the tokenizer to a new reader. Typically, an analyzer (in its reusableTokenStream method) will use this to re-use a previously created tokenizer. |
ToString (inherited from Object) | Returns a String that represents the current Object. |
Finalize (inherited from Object) | Allows an Object to attempt to free resources and perform other cleanup operations before the Object is reclaimed by garbage collection. |
MemberwiseClone (inherited from Object) | Creates a shallow copy of the current Object. |
SinkTokenizer Class | Lucene.Net.Analysis Namespace |