org.apache.nutch.util
Class NutchJobConf

java.lang.Object
  org.apache.hadoop.conf.Configuration
      org.apache.hadoop.mapred.JobConf
          org.apache.nutch.util.NutchJobConf

All Implemented Interfaces:

Iterable<Map.Entry<String,String>>, Writable

public class NutchJobConf
extends JobConf

A JobConf for Nutch jobs.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.conf.Configuration

Configuration.IntegerRanges

Field Summary

Fields inherited from class org.apache.hadoop.mapred.JobConf

DEFAULT_MAPRED_TASK_JAVA_OPTS, DEFAULT_QUEUE_NAME, DISABLED_MEMORY_LIMIT, MAPRED_LOCAL_DIR_PROPERTY, MAPRED_MAP_TASK_ENV, MAPRED_MAP_TASK_JAVA_OPTS, MAPRED_MAP_TASK_ULIMIT, MAPRED_REDUCE_TASK_ENV, MAPRED_REDUCE_TASK_JAVA_OPTS, MAPRED_REDUCE_TASK_ULIMIT, MAPRED_TASK_DEFAULT_MAXVMEM_PROPERTY, MAPRED_TASK_ENV, MAPRED_TASK_JAVA_OPTS, MAPRED_TASK_MAXPMEM_PROPERTY, MAPRED_TASK_MAXVMEM_PROPERTY, MAPRED_TASK_ULIMIT, UPPER_LIMIT_ON_TASK_VMEM_PROPERTY

Constructor Summary

NutchJobConf(Configuration conf)

Method Summary

Methods inherited from class org.apache.hadoop.mapred.JobConf

deleteLocalFiles, deleteLocalFiles, getCombinerClass, getCompressMapOutput, getCredentials, getInputFormat, getJar, getJobEndNotificationURI, getJobLocalDir, getJobName, getJobPriority, getKeepFailedTaskFiles, getKeepTaskFilesPattern, getKeyFieldComparatorOption, getKeyFieldPartitionerOption, getLocalDirs, getLocalPath, getMapDebugScript, getMapOutputCompressorClass, getMapOutputKeyClass, getMapOutputValueClass, getMapperClass, getMapRunnerClass, getMapSpeculativeExecution, getMaxMapAttempts, getMaxMapTaskFailuresPercent, getMaxPhysicalMemoryForTask, getMaxReduceAttempts, getMaxReduceTaskFailuresPercent, getMaxTaskFailuresPerTracker, getMaxVirtualMemoryForTask, getMemoryForMapTask, getMemoryForReduceTask, getNumMapTasks, getNumReduceTasks, getNumTasksToExecutePerJvm, getOutputCommitter, getOutputFormat, getOutputKeyClass, getOutputKeyComparator, getOutputValueClass, getOutputValueGroupingComparator, getPartitionerClass, getProfileEnabled, getProfileParams, getProfileTaskRange, getQueueName, getReduceDebugScript, getReducerClass, getReduceSpeculativeExecution, getSessionId, getSpeculativeExecution, getUseNewMapper, getUseNewReducer, getUser, getWorkingDirectory, normalizeMemoryConfigValue, setCombinerClass, setCompressMapOutput, setInputFormat, setJar, setJarByClass, setJobEndNotificationURI, setJobName, setJobPriority, setKeepFailedTaskFiles, setKeepTaskFilesPattern, setKeyFieldComparatorOptions, setKeyFieldPartitionerOptions, setMapDebugScript, setMapOutputCompressorClass, setMapOutputKeyClass, setMapOutputValueClass, setMapperClass, setMapRunnerClass, setMapSpeculativeExecution, setMaxMapAttempts, setMaxMapTaskFailuresPercent, setMaxPhysicalMemoryForTask, setMaxReduceAttempts, setMaxReduceTaskFailuresPercent, setMaxTaskFailuresPerTracker, setMaxVirtualMemoryForTask, setMemoryForMapTask, setMemoryForReduceTask, setNumMapTasks, setNumReduceTasks, setNumTasksToExecutePerJvm, setOutputCommitter, setOutputFormat, setOutputKeyClass, setOutputKeyComparatorClass, setOutputValueClass, setOutputValueGroupingComparator, setPartitionerClass, setProfileEnabled, setProfileParams, setProfileTaskRange, setQueueName, setReduceDebugScript, setReducerClass, setReduceSpeculativeExecution, setSessionId, setSpeculativeExecution, setUseNewMapper, setUseNewReducer, setUser, setWorkingDirectory

Methods inherited from class org.apache.hadoop.conf.Configuration

addDefaultResource, addResource, addResource, addResource, addResource, clear, dumpConfiguration, get, get, getBoolean, getClass, getClass, getClassByName, getClasses, getClassLoader, getConfResourceAsInputStream, getConfResourceAsReader, getEnum, getFile, getFloat, getInstances, getInt, getLocalPath, getLong, getRange, getRaw, getResource, getStringCollection, getStrings, getStrings, getValByRegex, iterator, main, readFields, reloadConfiguration, set, setBoolean, setBooleanIfUnset, setClass, setClassLoader, setEnum, setFloat, setIfUnset, setInt, setLong, setQuietMode, setStrings, size, toString, write, writeXml

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

NutchJobConf

public NutchJobConf(Configuration conf)