Creates a new instance of the {@link Lucene.Net.Analysis.Standard.StandardTokenizer}. Attaches the

input

to the newly created JFlex scanner.

Parameters

input

The input reader

replaceInvalidAcronym

Set to true to replace mischaracterized acronyms with HOST. See http://issues.apache.org/jira/browse/LUCENE-1068

See Also

StandardTokenizer Class | Lucene.Net.Analysis.Standard Namespace | StandardTokenizer Constructor Overload List

---