Apache Lucene.Net 2.4.0 Class Library API

SinkTokenizer Members

SinkTokenizer overview

Public Instance Constructors

SinkTokenizer Overloaded. Initializes a new instance of the SinkTokenizer class.

Public Instance Methods

Add Override this method to cache only certain tokens, or new tokens based on the old tokens.
Close 
Equals (inherited from Object)Determines whether the specified Object is equal to the current Object.
GetHashCode (inherited from Object)Serves as a hash function for a particular type. GetHashCode is suitable for use in hashing algorithms and data structures like a hash table.
GetTokens Get the tokens in the internal List. WARNING: Adding tokens to this list requires the {@link #Reset()} method to be called in order for them to be made available. Also, this Tokenizer does nothing to protect against {@link java.util.ConcurrentModificationException}s in the case of adds happening while {@link #Next(Lucene.Net.Analysis.Token)} is being called. WARNING: Since this SinkTokenizer can be reset and the cached tokens made available again, do not modify them. Modify clones instead.
GetType (inherited from Object)Gets the Type of the current instance.
NextOverloaded. Returns the next token out of the list of cached tokens
Next (inherited from TokenStream)Overloaded. Returns the next token in the stream, or null at EOS. @deprecated The returned Token is a "full private copy" (not re-used across calls to next()) but will be slower than calling {@link #Next(Token)} instead..
ResetOverloaded. Reset the internal data structures to the start at the front of the list of tokens. Should be called if tokens were added to the list after an invocation of {@link #Next(Token)}
Reset (inherited from Tokenizer)Overloaded. Expert: Reset the tokenizer to a new reader. Typically, an analyzer (in its reusableTokenStream method) will use this to re-use a previously created tokenizer.
ToString (inherited from Object)Returns a String that represents the current Object.

Protected Instance Methods

Finalize (inherited from Object)Allows an Object to attempt to free resources and perform other cleanup operations before the Object is reclaimed by garbage collection.
MemberwiseClone (inherited from Object)Creates a shallow copy of the current Object.

Protected Internal Instance Fields

input (inherited from Tokenizer)The text source for this Tokenizer.
iter 
lst 

See Also

SinkTokenizer Class | Lucene.Net.Analysis Namespace |