if a char is not a letter or digit, it is a word separator

Namespace: Lucene.Net.Analysis.Ext
Assembly: Lucene.Net.Contrib.Core (in Lucene.Net.Contrib.Core.dll) Version: 2.9.2.0 (2.9.2)

Syntax

C#
public class LetterOrDigitTokenizer : CharTokenizer

Visual Basic
Public Class LetterOrDigitTokenizer _ Inherits CharTokenizer

Visual C++
public ref class LetterOrDigitTokenizer : public CharTokenizer

Inheritance Hierarchy