org.apache.nutch.util
Class NutchJobConf

java.lang.Object
  org.apache.hadoop.conf.Configuration
      org.apache.hadoop.mapred.JobConf
          org.apache.nutch.util.NutchJobConf

All Implemented Interfaces:

Iterable<Map.Entry<String,String>>, org.apache.hadoop.io.Writable

public class NutchJobConf
extends org.apache.hadoop.mapred.JobConf

A JobConf for Nutch jobs.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.conf.Configuration

org.apache.hadoop.conf.Configuration.IntegerRanges

Field Summary

Fields inherited from class org.apache.hadoop.mapred.JobConf

DEFAULT_MAPRED_TASK_JAVA_OPTS, DEFAULT_MAPREDUCE_RECOVER_JOB, DEFAULT_QUEUE_NAME, DISABLED_MEMORY_LIMIT, MAPRED_JOB_MAP_MEMORY_MB_PROPERTY, MAPRED_JOB_REDUCE_MEMORY_MB_PROPERTY, MAPRED_LOCAL_DIR_PROPERTY, MAPRED_MAP_TASK_ENV, MAPRED_MAP_TASK_JAVA_OPTS, MAPRED_MAP_TASK_ULIMIT, MAPRED_REDUCE_TASK_ENV, MAPRED_REDUCE_TASK_JAVA_OPTS, MAPRED_REDUCE_TASK_ULIMIT, MAPRED_TASK_DEFAULT_MAXVMEM_PROPERTY, MAPRED_TASK_ENV, MAPRED_TASK_JAVA_OPTS, MAPRED_TASK_MAXPMEM_PROPERTY, MAPRED_TASK_MAXVMEM_PROPERTY, MAPRED_TASK_ULIMIT, MAPREDUCE_RECOVER_JOB, UPPER_LIMIT_ON_TASK_VMEM_PROPERTY, WORKFLOW_ADJACENCY_PREFIX_PATTERN, WORKFLOW_ADJACENCY_PREFIX_STRING, WORKFLOW_ID, WORKFLOW_NAME, WORKFLOW_NODE_NAME, WORKFLOW_TAGS

Constructor Summary

NutchJobConf(org.apache.hadoop.conf.Configuration conf)

Method Summary

Methods inherited from class org.apache.hadoop.mapred.JobConf

deleteLocalFiles, deleteLocalFiles, getCombinerClass, getCompressMapOutput, getCredentials, getInputFormat, getJar, getJobEndNotificationURI, getJobLocalDir, getJobName, getJobPriority, getKeepFailedTaskFiles, getKeepTaskFilesPattern, getKeyFieldComparatorOption, getKeyFieldPartitionerOption, getLocalDirs, getLocalPath, getMapDebugScript, getMapOutputCompressorClass, getMapOutputKeyClass, getMapOutputValueClass, getMapperClass, getMapRunnerClass, getMapSpeculativeExecution, getMaxMapAttempts, getMaxMapTaskFailuresPercent, getMaxPhysicalMemoryForTask, getMaxReduceAttempts, getMaxReduceTaskFailuresPercent, getMaxTaskFailuresPerTracker, getMaxVirtualMemoryForTask, getMemoryForMapTask, getMemoryForReduceTask, getNumMapTasks, getNumReduceTasks, getNumTasksToExecutePerJvm, getOutputCommitter, getOutputFormat, getOutputKeyClass, getOutputKeyComparator, getOutputValueClass, getOutputValueGroupingComparator, getPartitionerClass, getProfileEnabled, getProfileParams, getProfileTaskRange, getQueueName, getReduceDebugScript, getReducerClass, getReduceSpeculativeExecution, getSessionId, getSpeculativeExecution, getUseNewMapper, getUseNewReducer, getUser, getWorkingDirectory, normalizeMemoryConfigValue, setCombinerClass, setCompressMapOutput, setInputFormat, setJar, setJarByClass, setJobEndNotificationURI, setJobName, setJobPriority, setKeepFailedTaskFiles, setKeepTaskFilesPattern, setKeyFieldComparatorOptions, setKeyFieldPartitionerOptions, setMapDebugScript, setMapOutputCompressorClass, setMapOutputKeyClass, setMapOutputValueClass, setMapperClass, setMapRunnerClass, setMapSpeculativeExecution, setMaxMapAttempts, setMaxMapTaskFailuresPercent, setMaxPhysicalMemoryForTask, setMaxReduceAttempts, setMaxReduceTaskFailuresPercent, setMaxTaskFailuresPerTracker, setMaxVirtualMemoryForTask, setMemoryForMapTask, setMemoryForReduceTask, setNumMapTasks, setNumReduceTasks, setNumTasksToExecutePerJvm, setOutputCommitter, setOutputFormat, setOutputKeyClass, setOutputKeyComparatorClass, setOutputValueClass, setOutputValueGroupingComparator, setPartitionerClass, setProfileEnabled, setProfileParams, setProfileTaskRange, setQueueName, setReduceDebugScript, setReducerClass, setReduceSpeculativeExecution, setSessionId, setSpeculativeExecution, setUseNewMapper, setUseNewReducer, setUser, setWorkingDirectory

Methods inherited from class org.apache.hadoop.conf.Configuration

addDefaultResource, addResource, addResource, addResource, addResource, clear, dumpConfiguration, get, get, getBoolean, getClass, getClass, getClassByName, getClasses, getClassLoader, getConfResourceAsInputStream, getConfResourceAsReader, getEnum, getFile, getFloat, getInstances, getInt, getLocalPath, getLong, getRange, getRaw, getResource, getStringCollection, getStrings, getStrings, getValByRegex, iterator, main, readFields, reloadConfiguration, set, setBoolean, setBooleanIfUnset, setClass, setClassLoader, setEnum, setFloat, setIfUnset, setInt, setLong, setQuietMode, setStrings, size, toString, unset, write, writeXml, writeXml

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

NutchJobConf

public NutchJobConf(org.apache.hadoop.conf.Configuration conf)