org.apache.hadoop.hive.ql.exec.spark

Class HiveReduceFunctionResultList

java.lang.Object

org.apache.hadoop.hive.ql.exec.spark.HiveBaseFunctionResultList<scala.Tuple2<HiveKey,Iterable<org.apache.hadoop.io.BytesWritable>>>

org.apache.hadoop.hive.ql.exec.spark.HiveReduceFunctionResultList

All Implemented Interfaces:

Serializable, Iterable, org.apache.hadoop.mapred.OutputCollector<HiveKey,org.apache.hadoop.io.BytesWritable>

public class HiveReduceFunctionResultList
extends HiveBaseFunctionResultList<scala.Tuple2<HiveKey,Iterable<org.apache.hadoop.io.BytesWritable>>>

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.spark.HiveBaseFunctionResultList

HiveBaseFunctionResultList.ResultIterator

Constructor Summary

Constructors

Constructor and Description
HiveReduceFunctionResultList(Iterator<scala.Tuple2<HiveKey,Iterable<org.apache.hadoop.io.BytesWritable>>> inputIterator, SparkReduceRecordHandler reducer) Instantiate result set Iterable for Reduce function output.

Method Summary

Methods

Modifier and Type	Method and Description
protected void	closeRecordProcessor() Close the record processor.
protected boolean	processingDone()
protected void	processNextRecord(scala.Tuple2<HiveKey,Iterable<org.apache.hadoop.io.BytesWritable>> inputRecord) Process the given record.

Methods inherited from class org.apache.hadoop.hive.ql.exec.spark.HiveBaseFunctionResultList

collect, iterator

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HiveReduceFunctionResultList

public HiveReduceFunctionResultList(Iterator<scala.Tuple2<HiveKey,Iterable<org.apache.hadoop.io.BytesWritable>>> inputIterator,
                            SparkReduceRecordHandler reducer)

Instantiate result set Iterable for Reduce function output.

Parameters:

inputIterator - Input record iterator.

reducer - Initialized ExecReducer instance.

Method Detail

processNextRecord

protected void processNextRecord(scala.Tuple2<HiveKey,Iterable<org.apache.hadoop.io.BytesWritable>> inputRecord)
                          throws IOException

Description copied from class: HiveBaseFunctionResultList

Process the given record.

Specified by:

processNextRecord in class HiveBaseFunctionResultList<scala.Tuple2<HiveKey,Iterable<org.apache.hadoop.io.BytesWritable>>>

Throws:

IOException

processingDone

protected boolean processingDone()

Specified by:

processingDone in class HiveBaseFunctionResultList<scala.Tuple2<HiveKey,Iterable<org.apache.hadoop.io.BytesWritable>>>

Returns:

true if current state of the record processor is done.

closeRecordProcessor

protected void closeRecordProcessor()

Description copied from class: HiveBaseFunctionResultList

Close the record processor.

Specified by:

closeRecordProcessor in class HiveBaseFunctionResultList<scala.Tuple2<HiveKey,Iterable<org.apache.hadoop.io.BytesWritable>>>