Package | Description |
---|---|
org.apache.nutch.crawl |
Crawl control code.
|
org.apache.nutch.tools |
Modifier and Type | Method and Description |
---|---|
protected String |
Generator.GeneratorOutputFormat.generateFileNameForKeyValue(org.apache.hadoop.io.FloatWritable key,
Generator.SelectorEntry value,
String name) |
void |
Generator.SelectorInverseMapper.map(org.apache.hadoop.io.FloatWritable key,
Generator.SelectorEntry value,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,Generator.SelectorEntry> output,
org.apache.hadoop.mapred.Reporter reporter) |
Modifier and Type | Method and Description |
---|---|
void |
Generator.SelectorInverseMapper.map(org.apache.hadoop.io.FloatWritable key,
Generator.SelectorEntry value,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,Generator.SelectorEntry> output,
org.apache.hadoop.mapred.Reporter reporter) |
void |
Generator.Selector.map(org.apache.hadoop.io.Text key,
CrawlDatum value,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.FloatWritable,Generator.SelectorEntry> output,
org.apache.hadoop.mapred.Reporter reporter)
Select & invert subset due for fetch.
|
void |
Generator.Selector.reduce(org.apache.hadoop.io.FloatWritable key,
Iterator<Generator.SelectorEntry> values,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.FloatWritable,Generator.SelectorEntry> output,
org.apache.hadoop.mapred.Reporter reporter)
Collect until limit is reached.
|
void |
Generator.Selector.reduce(org.apache.hadoop.io.FloatWritable key,
Iterator<Generator.SelectorEntry> values,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.FloatWritable,Generator.SelectorEntry> output,
org.apache.hadoop.mapred.Reporter reporter)
Collect until limit is reached.
|
void |
Generator.PartitionReducer.reduce(org.apache.hadoop.io.Text key,
Iterator<Generator.SelectorEntry> values,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,CrawlDatum> output,
org.apache.hadoop.mapred.Reporter reporter) |
Modifier and Type | Method and Description |
---|---|
void |
FreeGenerator.FG.map(org.apache.hadoop.io.WritableComparable<?> key,
org.apache.hadoop.io.Text value,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,Generator.SelectorEntry> output,
org.apache.hadoop.mapred.Reporter reporter) |
void |
FreeGenerator.FG.reduce(org.apache.hadoop.io.Text key,
Iterator<Generator.SelectorEntry> values,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,CrawlDatum> output,
org.apache.hadoop.mapred.Reporter reporter) |
Copyright © 2014 The Apache Software Foundation