org.apache.hadoop.hive.ql.exec.spark

Class HiveBaseFunctionResultList<T>

java.lang.Object

org.apache.hadoop.hive.ql.exec.spark.HiveBaseFunctionResultList<T>

All Implemented Interfaces:

Serializable, Iterable, org.apache.hadoop.mapred.OutputCollector<HiveKey,org.apache.hadoop.io.BytesWritable>

Direct Known Subclasses:

HiveMapFunctionResultList, HiveReduceFunctionResultList

public abstract class HiveBaseFunctionResultList<T>
extends Object
implements Iterable, org.apache.hadoop.mapred.OutputCollector<HiveKey,org.apache.hadoop.io.BytesWritable>, Serializable

Base class for - collecting Map/Reduce function output and - providing an Iterable interface for fetching output records. Input records are processed in lazy fashion i.e when output records are requested through Iterator interface.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	HiveBaseFunctionResultList.ResultIterator Implement Iterator interface.

Constructor Summary

Constructors

Constructor and Description
HiveBaseFunctionResultList(Iterator<T> inputIterator)

Method Summary

Methods

Modifier and Type	Method and Description
protected abstract void	closeRecordProcessor() Close the record processor.
void	collect(HiveKey key, org.apache.hadoop.io.BytesWritable value)
Iterator	iterator()
protected abstract boolean	processingDone()
protected abstract void	processNextRecord(T inputRecord) Process the given record.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HiveBaseFunctionResultList

public HiveBaseFunctionResultList(Iterator<T> inputIterator)

Method Detail

iterator

public Iterator iterator()

Specified by:

iterator in interface Iterable

collect

public void collect(HiveKey key,
           org.apache.hadoop.io.BytesWritable value)
             throws IOException

Specified by:

collect in interface org.apache.hadoop.mapred.OutputCollector<HiveKey,org.apache.hadoop.io.BytesWritable>

Throws:

IOException

processNextRecord

protected abstract void processNextRecord(T inputRecord)
                                   throws IOException

Process the given record.

Throws:

IOException

processingDone

protected abstract boolean processingDone()

Returns:

true if current state of the record processor is done.

closeRecordProcessor

protected abstract void closeRecordProcessor()

Close the record processor.