org.apache.nutch.tools

Class FreeGenerator.FG

java.lang.Object

org.apache.hadoop.mapred.MapReduceBase

org.apache.nutch.tools.FreeGenerator.FG

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.WritableComparable<?>,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,Generator.SelectorEntry>, org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.Text,Generator.SelectorEntry,org.apache.hadoop.io.Text,CrawlDatum>

Enclosing class:

FreeGenerator

public static class FreeGenerator.FG
extends org.apache.hadoop.mapred.MapReduceBase
implements org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.WritableComparable<?>,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,Generator.SelectorEntry>, org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.Text,Generator.SelectorEntry,org.apache.hadoop.io.Text,CrawlDatum>

Constructor Summary

Constructors

Constructor and Description
FreeGenerator.FG()

Method Summary

Methods

Modifier and Type	Method and Description
void	configure(org.apache.hadoop.mapred.JobConf job)
void	map(org.apache.hadoop.io.WritableComparable<?> key, org.apache.hadoop.io.Text value, org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,Generator.SelectorEntry> output, org.apache.hadoop.mapred.Reporter reporter)
void	reduce(org.apache.hadoop.io.Text key, Iterator<Generator.SelectorEntry> values, org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,CrawlDatum> output, org.apache.hadoop.mapred.Reporter reporter)

Methods inherited from class org.apache.hadoop.mapred.MapReduceBase

close

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.io.Closeable

close

Constructor Detail

FreeGenerator.FG

public FreeGenerator.FG()

Method Detail

configure

public void configure(org.apache.hadoop.mapred.JobConf job)

Specified by:

configure in interface org.apache.hadoop.mapred.JobConfigurable

Overrides:

configure in class org.apache.hadoop.mapred.MapReduceBase

map

public void map(org.apache.hadoop.io.WritableComparable<?> key,
       org.apache.hadoop.io.Text value,
       org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,Generator.SelectorEntry> output,
       org.apache.hadoop.mapred.Reporter reporter)
         throws IOException

Specified by:

map in interface org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.WritableComparable<?>,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,Generator.SelectorEntry>

Throws:

IOException

reduce

public void reduce(org.apache.hadoop.io.Text key,
          Iterator<Generator.SelectorEntry> values,
          org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,CrawlDatum> output,
          org.apache.hadoop.mapred.Reporter reporter)
            throws IOException

Specified by:

reduce in interface org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.Text,Generator.SelectorEntry,org.apache.hadoop.io.Text,CrawlDatum>

Throws:

IOException