public class Injector extends NutchTool implements Tool
Modifier and Type | Class and Description |
---|---|
static class |
Injector.InjectMapper
Normalize and filter injected urls.
|
static class |
Injector.InjectReducer
Combine multiple new entries for a url.
|
Modifier and Type | Field and Description |
---|---|
static org.slf4j.Logger |
LOG |
static String |
nutchFetchIntervalMDName
metadata key reserved for setting a custom fetchInterval for a specific URL
|
static String |
nutchFixedFetchIntervalMDName
metadata key reserved for setting a fixed custom fetchInterval for a
specific URL
|
static String |
nutchScoreMDName
metadata key reserved for setting a custom score for a specific URL
|
currentJob, currentJobNum, numJobs, results, status
Constructor and Description |
---|
Injector() |
Injector(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
inject(Path crawlDb,
Path urlDir) |
static void |
main(String[] args) |
Map<String,Object> |
run(Map<String,String> args,
String crawlId)
Runs the tool, using a map of arguments.
|
int |
run(String[] args) |
getProgress, getStatus, killJob, stopJob
getConf, setConf
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
getConf, setConf
public static final org.slf4j.Logger LOG
public static String nutchScoreMDName
public static String nutchFetchIntervalMDName
public static String nutchFixedFetchIntervalMDName
public Injector()
public Injector(Configuration conf)
public void inject(Path crawlDb, Path urlDir) throws IOException
IOException
Copyright © 2015 The Apache Software Foundation