Initializes a new instance of the Tokenizer class.
protected internal Tokenizer();
protected internal Tokenizer(TextReader);
Tokenizer Class | Lucene.Net.Analysis Namespace