org.apache.nutch.fetcher
Class FetcherOutputFormat

java.lang.Object
  extended by org.apache.nutch.fetcher.FetcherOutputFormat
All Implemented Interfaces:
OutputFormat<Text,NutchWritable>

public class FetcherOutputFormat
extends Object
implements OutputFormat<Text,NutchWritable>

Splits FetcherOutput entries into multiple map files.


Constructor Summary
FetcherOutputFormat()
           
 
Method Summary
 void checkOutputSpecs(FileSystem fs, JobConf job)
           
 RecordWriter<Text,NutchWritable> getRecordWriter(FileSystem fs, JobConf job, String name, Progressable progress)
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

FetcherOutputFormat

public FetcherOutputFormat()
Method Detail

checkOutputSpecs

public void checkOutputSpecs(FileSystem fs,
                             JobConf job)
                      throws IOException
Specified by:
checkOutputSpecs in interface OutputFormat<Text,NutchWritable>
Throws:
IOException

getRecordWriter

public RecordWriter<Text,NutchWritable> getRecordWriter(FileSystem fs,
                                                        JobConf job,
                                                        String name,
                                                        Progressable progress)
                                                 throws IOException
Specified by:
getRecordWriter in interface OutputFormat<Text,NutchWritable>
Throws:
IOException


Copyright © 2011 The Apache Software Foundation