Package org.apache.hadoop.hive.ql.exec.spark

Interface Summary

Interface	Description
HiveSparkClient
SparkShuffler
SparkTran<KI extends org.apache.hadoop.io.WritableComparable,VI,KO extends org.apache.hadoop.io.WritableComparable,VO>

Class Summary

Class	Description
GroupByShuffler
HashTableLoader	HashTableLoader for Spark to load the hashtable for MapJoins.
HiveBaseFunctionResultList<T>	Base class for - collecting Map/Reduce function output and - providing an Iterable interface for fetching output records.
HiveMapFunction
HiveMapFunctionResultList
HivePairFlatMapFunction<T,K,V>
HiveReduceFunction
HiveReduceFunctionResultList
HiveSparkClientFactory
HiveVoidFunction	Implementation of a voidFunction that does nothing.
KryoSerializer
LocalHiveSparkClient	LocalSparkClient submit Spark job in local driver, it's responsible for build spark client environment and execute spark work.
MapInput
MapTran
ReduceTran
RemoteHiveSparkClient	RemoteSparkClient is a wrapper of SparkClient, which wrap a spark job request and send to an remote SparkContext.
ShuffleTran
SortByShuffler
SparkMapRecordHandler	Clone from ExecMapper.
SparkMergeFileRecordHandler	Copied from MergeFileMapper.
SparkPlan
SparkPlanGenerator
SparkRecordHandler
SparkReduceRecordHandler	Clone from ExecReducer, it is the bridge between the spark framework and the Hive operator pipeline at execution time.
SparkReporter	Implement SparkReporter for Hive operator level statistics collection, and throw UnsupportedOperationException for other unrelated methods, so if any Hive feature depends on these unimplemented methods, we could go back here quickly and enable it.
SparkTask
SparkUtilities	Contains utilities methods used as part of Spark tasks.