Token Constructor (String, Int32, Int32)

Constructs a Token with the given term text, and start and end offsets. The type defaults to "word." NOTE: for better indexing speed you should instead use the char[] termBuffer methods to set the term text.

public Token(
   string text,
   int start,
   int end
);