Overload List
Name | Description | |
---|---|---|
Tokenizer()()()() | Construct a tokenizer with null input. | |
Tokenizer(TextReader) | Construct a token stream processing the given input. | |
Tokenizer(AttributeSource) | Construct a token stream processing the given input using the given AttributeSource. | |
Tokenizer(AttributeSource..::..AttributeFactory) | Construct a tokenizer with null input using the given AttributeFactory. | |
Tokenizer(AttributeSource, TextReader) | Construct a token stream processing the given input using the given AttributeSource. | |
Tokenizer(AttributeSource..::..AttributeFactory, TextReader) | Construct a token stream processing the given input using the given AttributeFactory. |