Construct a tokenizer with null input.
protected internal Tokenizer();
Construct a token stream processing the given input.
protected internal Tokenizer(TextReader);
Tokenizer Class | Lucene.Net.Analysis Namespace