public class Injector
extends org.apache.hadoop.conf.Configured
implements org.apache.hadoop.util.Tool
Modifier and Type | Class and Description |
---|---|
static class |
Injector.InjectMapper
Normalize and filter injected urls.
|
static class |
Injector.InjectReducer
Combine multiple new entries for a url.
|
Modifier and Type | Field and Description |
---|---|
static org.slf4j.Logger |
LOG |
static String |
nutchFetchIntervalMDName
metadata key reserved for setting a custom fetchInterval for a specific URL
|
static String |
nutchFixedFetchIntervalMDName
metadata key reserved for setting a fixed custom fetchInterval for a specific URL
|
static String |
nutchScoreMDName
metadata key reserved for setting a custom score for a specific URL
|
Constructor and Description |
---|
Injector() |
Injector(org.apache.hadoop.conf.Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
inject(org.apache.hadoop.fs.Path crawlDb,
org.apache.hadoop.fs.Path urlDir) |
static void |
main(String[] args) |
int |
run(String[] args) |
public static final org.slf4j.Logger LOG
public static String nutchScoreMDName
public static String nutchFetchIntervalMDName
public static String nutchFixedFetchIntervalMDName
public Injector()
public Injector(org.apache.hadoop.conf.Configuration conf)
public void inject(org.apache.hadoop.fs.Path crawlDb, org.apache.hadoop.fs.Path urlDir) throws IOException
IOException
Copyright © 2014 The Apache Software Foundation