public class SegmentMergeFilters extends Object
SegmentMergeFilter
extensions in a single object
so it is easier to operate on them. If any of extensions returns
false this one will return false as well.Constructor and Description |
---|
SegmentMergeFilters(org.apache.hadoop.conf.Configuration conf) |
Modifier and Type | Method and Description |
---|---|
boolean |
filter(org.apache.hadoop.io.Text key,
CrawlDatum generateData,
CrawlDatum fetchData,
CrawlDatum sigData,
Content content,
ParseData parseData,
ParseText parseText,
Collection<CrawlDatum> linked)
Iterates over all
SegmentMergeFilter extensions and if any of them
returns false, it will return false as well. |
public SegmentMergeFilters(org.apache.hadoop.conf.Configuration conf)
public boolean filter(org.apache.hadoop.io.Text key, CrawlDatum generateData, CrawlDatum fetchData, CrawlDatum sigData, Content content, ParseData parseData, ParseText parseText, Collection<CrawlDatum> linked)
SegmentMergeFilter
extensions and if any of them
returns false, it will return false as well.Copyright © 2014 The Apache Software Foundation