org.apache.nutch.tools

Class CommonCrawlFormatFactory

java.lang.Object

org.apache.nutch.tools.CommonCrawlFormatFactory

public class CommonCrawlFormatFactory
extends Object

Factory class that creates new CommonCrawlFormat objects (a.k.a. formatter) that map crawled files to CommonCrawl format.

Constructor Summary

Constructors

Constructor and Description
CommonCrawlFormatFactory()

Method Summary

Methods

Modifier and Type	Method and Description
static CommonCrawlFormat	getCommonCrawlFormat(String formatType, String url, byte[] content, Metadata metadata, Configuration nutchConf, CommonCrawlConfig config) Returns a new instance of a CommonCrawlFormat object specifying the type of formatter.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CommonCrawlFormatFactory

public CommonCrawlFormatFactory()

Method Detail

getCommonCrawlFormat

public static CommonCrawlFormat getCommonCrawlFormat(String formatType,
                                     String url,
                                     byte[] content,
                                     Metadata metadata,
                                     Configuration nutchConf,
                                     CommonCrawlConfig config)
                                              throws IOException

Returns a new instance of a CommonCrawlFormat object specifying the type of formatter.

Parameters:

formatType - the type of formatter to be created.

url - the url.

content - the content.

metadata - the metadata.

nutchConf - the configuration.

config - the CommonCrawl output configuration.

Returns:

the new CommonCrawlFormat object.

Throws:

IOException - If any I/O error occurs.