org.apache.nutch.fetcher

Class FetcherOutputFormat

java.lang.Object

org.apache.nutch.fetcher.FetcherOutputFormat

All Implemented Interfaces:

org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,NutchWritable>

public class FetcherOutputFormat
extends Object
implements org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,NutchWritable>

Splits FetcherOutput entries into multiple map files.

Constructor Summary

Constructors

Constructor and Description
FetcherOutputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
void	checkOutputSpecs(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.mapred.JobConf job)
org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.Text,NutchWritable>	getRecordWriter(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.mapred.JobConf job, String name, org.apache.hadoop.util.Progressable progress)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FetcherOutputFormat

public FetcherOutputFormat()

Method Detail

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.fs.FileSystem fs,
                    org.apache.hadoop.mapred.JobConf job)
                      throws IOException

Specified by:

checkOutputSpecs in interface org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,NutchWritable>

Throws:

IOException

getRecordWriter

public org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.Text,NutchWritable> getRecordWriter(org.apache.hadoop.fs.FileSystem fs,
                                                                                             org.apache.hadoop.mapred.JobConf job,
                                                                                             String name,
                                                                                             org.apache.hadoop.util.Progressable progress)
                                                                                               throws IOException

Specified by:

getRecordWriter in interface org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,NutchWritable>

Throws:

IOException