org.apache.hadoop.mapred.split

Class TezGroupedSplitsInputFormat<K,V>

java.lang.Object

org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat<K,V>

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.mapred.InputFormat<K,V>

@InterfaceAudience.Public
 @InterfaceStability.Evolving
public class TezGroupedSplitsInputFormat<K,V>
extends Object
implements org.apache.hadoop.mapred.InputFormat<K,V>, org.apache.hadoop.conf.Configurable

An InputFormat that provides a generic grouping around the splits of a real InputFormat

Constructor Summary

Constructors

Constructor and Description
TezGroupedSplitsInputFormat()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.conf.Configuration	getConf()
org.apache.hadoop.mapred.RecordReader<K,V>	getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter)
org.apache.hadoop.mapred.InputSplit[]	getSplits(org.apache.hadoop.mapred.JobConf job, int numSplits)
void	setConf(org.apache.hadoop.conf.Configuration conf)
void	setDesiredNumberOfSplits(int num)
void	setInputFormat(org.apache.hadoop.mapred.InputFormat<K,V> wrappedInputFormat)
void	setSplitLocationProvider(org.apache.hadoop.mapred.split.SplitLocationProvider locationProvider)
void	setSplitSizeEstimator(org.apache.hadoop.mapred.split.SplitSizeEstimator estimator)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TezGroupedSplitsInputFormat

public TezGroupedSplitsInputFormat()

Method Detail

setInputFormat

public void setInputFormat(org.apache.hadoop.mapred.InputFormat<K,V> wrappedInputFormat)

setSplitSizeEstimator

public void setSplitSizeEstimator(org.apache.hadoop.mapred.split.SplitSizeEstimator estimator)

setSplitLocationProvider

public void setSplitLocationProvider(org.apache.hadoop.mapred.split.SplitLocationProvider locationProvider)

setDesiredNumberOfSplits

public void setDesiredNumberOfSplits(int num)

getSplits

public org.apache.hadoop.mapred.InputSplit[] getSplits(org.apache.hadoop.mapred.JobConf job,
                                                       int numSplits)
                                                throws IOException

Specified by:

getSplits in interface org.apache.hadoop.mapred.InputFormat<K,V>

Throws:

IOException

getRecordReader

public org.apache.hadoop.mapred.RecordReader<K,V> getRecordReader(org.apache.hadoop.mapred.InputSplit split,
                                                                  org.apache.hadoop.mapred.JobConf job,
                                                                  org.apache.hadoop.mapred.Reporter reporter)
                                                           throws IOException

Specified by:

getRecordReader in interface org.apache.hadoop.mapred.InputFormat<K,V>

Throws:

IOException

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable