org.apache.hadoop.hive.shims

Class HadoopShimsSecure.CombineFileInputFormatShim<K,V>

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V>

org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat<K,V>

org.apache.hadoop.mapred.lib.CombineFileInputFormat<K,V>

org.apache.hadoop.hive.shims.HadoopShimsSecure.CombineFileInputFormatShim<K,V>

All Implemented Interfaces:

HadoopShims.CombineFileInputFormatShim<K,V>, org.apache.hadoop.mapred.InputFormat<K,V>

Enclosing class:

HadoopShimsSecure

public abstract static class HadoopShimsSecure.CombineFileInputFormatShim<K,V>
extends org.apache.hadoop.mapred.lib.CombineFileInputFormat<K,V>
implements HadoopShims.CombineFileInputFormatShim<K,V>

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

org.apache.hadoop.mapreduce.lib.input.FileInputFormat.Counter

Field Summary

Fields inherited from class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat

SPLIT_MINSIZE_PERNODE, SPLIT_MINSIZE_PERRACK

Fields inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

DEFAULT_LIST_STATUS_NUM_THREADS, INPUT_DIR, INPUT_DIR_RECURSIVE, LIST_STATUS_NUM_THREADS, NUM_INPUT_FILES, PATHFILTER_CLASS, SPLIT_MAXSIZE, SPLIT_MINSIZE

Constructor Summary

Constructors

Constructor and Description
HadoopShimsSecure.CombineFileInputFormatShim()

Method Summary

Methods

Modifier and Type	Method and Description
void	createPool(org.apache.hadoop.mapred.JobConf conf, org.apache.hadoop.fs.PathFilter... filters)
org.apache.hadoop.fs.Path[]	getInputPathsShim(org.apache.hadoop.mapred.JobConf conf)
HadoopShimsSecure.InputSplitShim	getInputSplitShim()
org.apache.hadoop.mapred.RecordReader	getRecordReader(org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.lib.CombineFileSplit split, org.apache.hadoop.mapred.Reporter reporter, Class<org.apache.hadoop.mapred.RecordReader<K,V>> rrClass)
org.apache.hadoop.mapred.lib.CombineFileSplit[]	getSplits(org.apache.hadoop.mapred.JobConf job, int numSplits)

Methods inherited from class org.apache.hadoop.mapred.lib.CombineFileInputFormat

createPool, createRecordReader, getRecordReader, isSplitable, isSplitable, listStatus

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat

createPool, createPool, getFileBlockLocations, getSplits, setMaxSplitSize, setMinSplitSizeNode, setMinSplitSizeRack

Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputDirRecursive, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, listStatus, makeSplit, makeSplit, setInputDirRecursive, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopShimsSecure.CombineFileInputFormatShim

public HadoopShimsSecure.CombineFileInputFormatShim()

Method Detail

getInputPathsShim

public org.apache.hadoop.fs.Path[] getInputPathsShim(org.apache.hadoop.mapred.JobConf conf)

Specified by:

getInputPathsShim in interface HadoopShims.CombineFileInputFormatShim<K,V>

createPool

public void createPool(org.apache.hadoop.mapred.JobConf conf,
              org.apache.hadoop.fs.PathFilter... filters)

Specified by:

createPool in interface HadoopShims.CombineFileInputFormatShim<K,V>

Overrides:

createPool in class org.apache.hadoop.mapred.lib.CombineFileInputFormat<K,V>

getSplits

public org.apache.hadoop.mapred.lib.CombineFileSplit[] getSplits(org.apache.hadoop.mapred.JobConf job,
                                                        int numSplits)
                                                          throws IOException

Specified by:

getSplits in interface HadoopShims.CombineFileInputFormatShim<K,V>

Specified by:

getSplits in interface org.apache.hadoop.mapred.InputFormat<K,V>

Overrides:

getSplits in class org.apache.hadoop.mapred.lib.CombineFileInputFormat<K,V>

Throws:

IOException

getInputSplitShim

public HadoopShimsSecure.InputSplitShim getInputSplitShim()
                                                   throws IOException

Specified by:

getInputSplitShim in interface HadoopShims.CombineFileInputFormatShim<K,V>

Throws:

IOException

getRecordReader

public org.apache.hadoop.mapred.RecordReader getRecordReader(org.apache.hadoop.mapred.JobConf job,
                                                    org.apache.hadoop.mapred.lib.CombineFileSplit split,
                                                    org.apache.hadoop.mapred.Reporter reporter,
                                                    Class<org.apache.hadoop.mapred.RecordReader<K,V>> rrClass)
                                                      throws IOException

Specified by:

getRecordReader in interface HadoopShims.CombineFileInputFormatShim<K,V>

Throws:

IOException