org.apache.nutch.indexer.subcollection
Class SubcollectionIndexingFilter

java.lang.Object
  org.apache.hadoop.conf.Configured
      org.apache.nutch.indexer.subcollection.SubcollectionIndexingFilter

All Implemented Interfaces:

Configurable, IndexingFilter, Pluggable

public class SubcollectionIndexingFilter
extends Configured
implements IndexingFilter

Field Summary

static String	fieldName Doc field name
static org.slf4j.Logger	LOG Logger

Fields inherited from interface org.apache.nutch.indexer.IndexingFilter

X_POINT_ID

Constructor Summary

SubcollectionIndexingFilter()

SubcollectionIndexingFilter(Configuration conf)

Method Summary

NutchDocument	filter(NutchDocument doc, Parse parse, Text url, CrawlDatum datum, Inlinks inlinks) Adds fields or otherwise modifies the document that will be indexed for a parse.
Configuration	getConf()
void	setConf(Configuration conf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

fieldName

public static String fieldName

Doc field name

LOG

public static final org.slf4j.Logger LOG

Logger

Constructor Detail

SubcollectionIndexingFilter

public SubcollectionIndexingFilter()

SubcollectionIndexingFilter

public SubcollectionIndexingFilter(Configuration conf)

Method Detail

setConf

public void setConf(Configuration conf)

Specified by:

setConf in interface Configurable

Overrides:

setConf in class Configured

Parameters:

Configuration - conf

getConf

public Configuration getConf()

Specified by:

getConf in interface Configurable

Overrides:

getConf in class Configured

Returns:

Configuration

filter

public NutchDocument filter(NutchDocument doc,
                            Parse parse,
                            Text url,
                            CrawlDatum datum,
                            Inlinks inlinks)
                     throws IndexingException

Description copied from interface: IndexingFilter

Adds fields or otherwise modifies the document that will be indexed for a parse. Unwanted documents can be removed from indexing by returning a null value.

Specified by:

filter in interface IndexingFilter

Parameters:

doc - document instance for collecting fields

parse - parse data instance

url - page url

datum - crawl datum for the page

inlinks - page inlinks

Returns:

modified (or a new) document instance, or null (meaning the document should be discarded)

Throws:

IndexingException