Creates a new instance of the {@link StandardTokenizer}. Attaches the

input

to a newly created JFlex scanner.

Overload List

Creates a new instance of the {@link StandardTokenizer}. Attaches the

input

to a newly created JFlex scanner.

public StandardTokenizer(TextReader);

Creates a new instance of the {@link Lucene.Net.Analysis.Standard.StandardTokenizer}. Attaches the

input

to the newly created JFlex scanner.

public StandardTokenizer(TextReader,bool);

See Also

StandardTokenizer Class | Lucene.Net.Analysis.Standard Namespace

---