org.apache.lucene.analysis.miscellaneous
Class RemoveDuplicatesTokenFilter
java.lang.Object
org.apache.lucene.util.AttributeSource
org.apache.lucene.analysis.TokenStream
org.apache.lucene.analysis.TokenFilter
org.apache.lucene.analysis.miscellaneous.RemoveDuplicatesTokenFilter
- All Implemented Interfaces:
- Closeable
public final class RemoveDuplicatesTokenFilter
- extends TokenFilter
A TokenFilter which filters out Tokens at the same position and Term text as the previous token in the stream.
Methods inherited from class org.apache.lucene.util.AttributeSource |
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState |
RemoveDuplicatesTokenFilter
public RemoveDuplicatesTokenFilter(TokenStream in)
- Creates a new RemoveDuplicatesTokenFilter
- Parameters:
in
- TokenStream that will be filtered
incrementToken
public boolean incrementToken()
throws IOException
-
- Specified by:
incrementToken
in class TokenStream
- Throws:
IOException
reset
public void reset()
throws IOException
-
- Overrides:
reset
in class TokenFilter
- Throws:
IOException
Copyright © 2000-2013 Apache Software Foundation. All Rights Reserved.