Overload List

  NameDescription
Protected methodTokenizer()()()()
Construct a tokenizer with null input.
Protected methodTokenizer(TextReader)
Construct a token stream processing the given input.
Protected methodTokenizer(AttributeSource)
Construct a token stream processing the given input using the given AttributeSource.
Protected methodTokenizer(AttributeSource..::..AttributeFactory)
Construct a tokenizer with null input using the given AttributeFactory.
Protected methodTokenizer(AttributeSource, TextReader)
Construct a token stream processing the given input using the given AttributeSource.
Protected methodTokenizer(AttributeSource..::..AttributeFactory, TextReader)
Construct a token stream processing the given input using the given AttributeFactory.

See Also