Constructs a tokenizer for this Reader.
public StandardTokenizer(CharStream);
public StandardTokenizer(StandardTokenizerTokenManager);
Constructs a tokenizer for this Reader.
public StandardTokenizer(TextReader);
StandardTokenizer Class | Lucene.Net.Analysis.Standard Namespace