Creates a new instance of the {@link StandardTokenizer}. Attaches the
inputto a newly created JFlex scanner.
Creates a new instance of the {@link StandardTokenizer}. Attaches the
inputto a newly created JFlex scanner.
public StandardTokenizer(TextReader);
Creates a new instance of the {@link Lucene.Net.Analysis.Standard.StandardTokenizer}. Attaches the
inputto the newly created JFlex scanner.
public StandardTokenizer(TextReader,bool);
StandardTokenizer Class | Lucene.Net.Analysis.Standard Namespace