StandardTokenizer Constructor

Constructs a tokenizer for this Reader.

public StandardTokenizer(CharStream);

public StandardTokenizer(StandardTokenizerTokenManager);

Constructs a tokenizer for this Reader.

public StandardTokenizer(TextReader);