public class SubcollectionIndexingFilter extends Configured implements IndexingFilter
Modifier and Type | Field and Description |
---|---|
static String |
fieldName
Doc field name
|
static org.slf4j.Logger |
LOG
Logger
|
X_POINT_ID
Constructor and Description |
---|
SubcollectionIndexingFilter() |
SubcollectionIndexingFilter(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
NutchDocument |
filter(NutchDocument doc,
Parse parse,
Text url,
CrawlDatum datum,
Inlinks inlinks)
Adds fields or otherwise modifies the document that will be indexed for a
parse.
|
Configuration |
getConf() |
void |
setConf(Configuration conf) |
public static String fieldName
public static final org.slf4j.Logger LOG
public SubcollectionIndexingFilter()
public SubcollectionIndexingFilter(Configuration conf)
public void setConf(Configuration conf)
setConf
in interface Configurable
setConf
in class Configured
Configuration
- confpublic Configuration getConf()
getConf
in interface Configurable
getConf
in class Configured
public NutchDocument filter(NutchDocument doc, Parse parse, Text url, CrawlDatum datum, Inlinks inlinks) throws IndexingException
IndexingFilter
filter
in interface IndexingFilter
doc
- document instance for collecting fieldsparse
- parse data instanceurl
- page urldatum
- crawl datum for the page (fetch datum from segment containing
fetch status and fetch time)inlinks
- page inlinksIndexingException
Copyright © 2015 The Apache Software Foundation