org.apache.nutch.tools
Class FreeGenerator

java.lang.Object
  org.apache.hadoop.conf.Configured
      org.apache.nutch.tools.FreeGenerator

All Implemented Interfaces:

Configurable, Tool

public class FreeGenerator
extends Configured
implements Tool

This tool generates fetchlists (segments to be fetched) from plain text files containing one URL per line. It's useful when arbitrary URL-s need to be fetched without adding them first to the CrawlDb, or during testing.

Author:

Andrzej Bialecki

Nested Class Summary

static class

FreeGenerator.FG

Constructor Summary

FreeGenerator()

Method Summary

static void	main(String[] args)
int	run(String[] args)

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Constructor Detail

FreeGenerator

public FreeGenerator()

Method Detail

run

public int run(String[] args)
        throws Exception

Specified by:

run in interface Tool

Throws:

Exception

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception