@Deprecated public final class Lucene43EdgeNGramTokenizer extends Tokenizer
EdgeNGramTokenizer
which doesn't handle correctly
supplementary characters.Modifier and Type | Class and Description |
---|---|
static class |
Lucene43EdgeNGramTokenizer.Side
Deprecated.
Specifies which side of the input the n-gram should be generated from
|
AttributeSource.AttributeFactory, AttributeSource.State
Modifier and Type | Field and Description |
---|---|
static int |
DEFAULT_MAX_GRAM_SIZE
Deprecated.
|
static int |
DEFAULT_MIN_GRAM_SIZE
Deprecated.
|
static Lucene43EdgeNGramTokenizer.Side |
DEFAULT_SIDE
Deprecated.
|
Constructor and Description |
---|
Lucene43EdgeNGramTokenizer(Version version,
AttributeSource.AttributeFactory factory,
Reader input,
int minGram,
int maxGram)
Deprecated.
Creates EdgeNGramTokenizer that can generate n-grams in the sizes of the given range
|
Lucene43EdgeNGramTokenizer(Version version,
AttributeSource.AttributeFactory factory,
Reader input,
Lucene43EdgeNGramTokenizer.Side side,
int minGram,
int maxGram)
Deprecated.
|
Lucene43EdgeNGramTokenizer(Version version,
AttributeSource.AttributeFactory factory,
Reader input,
String sideLabel,
int minGram,
int maxGram)
Deprecated.
|
Lucene43EdgeNGramTokenizer(Version version,
Reader input,
int minGram,
int maxGram)
Deprecated.
Creates EdgeNGramTokenizer that can generate n-grams in the sizes of the given range
|
Lucene43EdgeNGramTokenizer(Version version,
Reader input,
Lucene43EdgeNGramTokenizer.Side side,
int minGram,
int maxGram)
Deprecated.
|
Lucene43EdgeNGramTokenizer(Version version,
Reader input,
String sideLabel,
int minGram,
int maxGram)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
void |
end()
Deprecated.
|
boolean |
incrementToken()
Deprecated.
Returns the next token in the stream, or null at EOS.
|
void |
reset()
Deprecated.
|
close, correctOffset, setReader
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState
public static final Lucene43EdgeNGramTokenizer.Side DEFAULT_SIDE
public static final int DEFAULT_MAX_GRAM_SIZE
public static final int DEFAULT_MIN_GRAM_SIZE
@Deprecated public Lucene43EdgeNGramTokenizer(Version version, Reader input, Lucene43EdgeNGramTokenizer.Side side, int minGram, int maxGram)
version
- the Lucene match versioninput
- Reader
holding the input to be tokenizedside
- the Lucene43EdgeNGramTokenizer.Side
from which to chop off an n-gramminGram
- the smallest n-gram to generatemaxGram
- the largest n-gram to generate@Deprecated public Lucene43EdgeNGramTokenizer(Version version, AttributeSource.AttributeFactory factory, Reader input, Lucene43EdgeNGramTokenizer.Side side, int minGram, int maxGram)
version
- the Lucene match versionfactory
- AttributeSource.AttributeFactory
to useinput
- Reader
holding the input to be tokenizedside
- the Lucene43EdgeNGramTokenizer.Side
from which to chop off an n-gramminGram
- the smallest n-gram to generatemaxGram
- the largest n-gram to generate@Deprecated public Lucene43EdgeNGramTokenizer(Version version, Reader input, String sideLabel, int minGram, int maxGram)
version
- the Lucene match versioninput
- Reader
holding the input to be tokenizedsideLabel
- the name of the Lucene43EdgeNGramTokenizer.Side
from which to chop off an n-gramminGram
- the smallest n-gram to generatemaxGram
- the largest n-gram to generate@Deprecated public Lucene43EdgeNGramTokenizer(Version version, AttributeSource.AttributeFactory factory, Reader input, String sideLabel, int minGram, int maxGram)
version
- the Lucene match versionfactory
- AttributeSource.AttributeFactory
to useinput
- Reader
holding the input to be tokenizedsideLabel
- the name of the Lucene43EdgeNGramTokenizer.Side
from which to chop off an n-gramminGram
- the smallest n-gram to generatemaxGram
- the largest n-gram to generatepublic Lucene43EdgeNGramTokenizer(Version version, Reader input, int minGram, int maxGram)
version
- the Lucene match versioninput
- Reader
holding the input to be tokenizedminGram
- the smallest n-gram to generatemaxGram
- the largest n-gram to generatepublic Lucene43EdgeNGramTokenizer(Version version, AttributeSource.AttributeFactory factory, Reader input, int minGram, int maxGram)
version
- the Lucene match versionfactory
- AttributeSource.AttributeFactory
to useinput
- Reader
holding the input to be tokenizedminGram
- the smallest n-gram to generatemaxGram
- the largest n-gram to generatepublic boolean incrementToken() throws IOException
incrementToken
in class TokenStream
IOException
public void end()
end
in class TokenStream
public void reset() throws IOException
reset
in class TokenStream
IOException
Copyright © 2000-2013 Apache Software Foundation. All Rights Reserved.