True iff the value of the field should be tokenized as text prior to indexing. Un-tokenized fields are indexed as a single word and may not be Reader-valued.
Fieldable.IsTokenized
AbstractField Class | Lucene.Net.Documents Namespace