org.apache.nutch.indexer.filter

Class MimeTypeIndexingFilter

java.lang.Object

org.apache.nutch.indexer.filter.MimeTypeIndexingFilter

All Implemented Interfaces:

Configurable, IndexingFilter, Pluggable

public class MimeTypeIndexingFilter
extends Object
implements IndexingFilter

An IndexingFilter that allows filtering of documents based on the MIME Type detected by Tika

Field Summary

Fields

Modifier and Type	Field and Description
static String	MIMEFILTER_REGEX_FILE

Fields inherited from interface org.apache.nutch.indexer.IndexingFilter

X_POINT_ID

Constructor Summary

Constructors

Constructor and Description
MimeTypeIndexingFilter()

Method Summary

Methods

Modifier and Type	Method and Description
NutchDocument	filter(NutchDocument doc, Parse parse, Text url, CrawlDatum datum, Inlinks inlinks) Adds fields or otherwise modifies the document that will be indexed for a parse.
Configuration	getConf()
static void	main(String[] args) Main method for invoking this tool
void	setConf(Configuration conf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MIMEFILTER_REGEX_FILE

public static final String MIMEFILTER_REGEX_FILE

See Also:

Constant Field Values

Constructor Detail

MimeTypeIndexingFilter

public MimeTypeIndexingFilter()

Method Detail

filter

public NutchDocument filter(NutchDocument doc,
                   Parse parse,
                   Text url,
                   CrawlDatum datum,
                   Inlinks inlinks)
                     throws IndexingException

Description copied from interface: IndexingFilter

Adds fields or otherwise modifies the document that will be indexed for a parse. Unwanted documents can be removed from indexing by returning a null value.

Specified by:

filter in interface IndexingFilter

Parameters:

doc - document instance for collecting fields

parse - parse data instance

url - page url

datum - crawl datum for the page (fetch datum from segment containing fetch status and fetch time)

inlinks - page inlinks

Returns:

modified (or a new) document instance, or null (meaning the document should be discarded)

Throws:

IndexingException

setConf

public void setConf(Configuration conf)

Specified by:

setConf in interface Configurable

getConf

public Configuration getConf()

Specified by:

getConf in interface Configurable

main

public static void main(String[] args)
                 throws IOException,
                        IndexingException

Main method for invoking this tool

Throws:

IOException, - IndexingException

IOException

IndexingException