|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.apache.hadoop.conf.Configured org.apache.nutch.scoring.webgraph.WebGraph.OutlinkDb
public static class WebGraph.OutlinkDb
The OutlinkDb creates a database of all outlinks. Outlinks to internal urls by domain and host can be ignored. The number of Outlinks out to a given page or domain can also be limited.
Constructor Summary | |
---|---|
WebGraph.OutlinkDb()
Default constructor. |
|
WebGraph.OutlinkDb(Configuration conf)
Configurable constructor. |
Method Summary | |
---|---|
void |
close()
|
void |
configure(JobConf conf)
Configures the OutlinkDb job. |
void |
map(Text key,
Writable value,
OutputCollector<Text,LinkDatum> output,
Reporter reporter)
Passes through existing LinkDatum objects from an existing OutlinkDb and maps out new LinkDatum objects from new crawls ParseData. |
void |
reduce(Text key,
Iterator<LinkDatum> values,
OutputCollector<Text,LinkDatum> output,
Reporter reporter)
|
Methods inherited from class org.apache.hadoop.conf.Configured |
---|
getConf, setConf |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public WebGraph.OutlinkDb()
public WebGraph.OutlinkDb(Configuration conf)
Method Detail |
---|
public void configure(JobConf conf)
configure
in interface JobConfigurable
public void map(Text key, Writable value, OutputCollector<Text,LinkDatum> output, Reporter reporter) throws IOException
map
in interface Mapper<Text,Writable,Text,LinkDatum>
IOException
public void reduce(Text key, Iterator<LinkDatum> values, OutputCollector<Text,LinkDatum> output, Reporter reporter) throws IOException
reduce
in interface Reducer<Text,LinkDatum,Text,LinkDatum>
IOException
public void close()
close
in interface Closeable
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |