org.apache.hadoop.hive.ql.exec.vector

Class VectorMapJoinBaseOperator

java.lang.Object

org.apache.hadoop.hive.ql.exec.Operator<T>

org.apache.hadoop.hive.ql.exec.CommonJoinOperator<T>

org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator<MapJoinDesc>

org.apache.hadoop.hive.ql.exec.MapJoinOperator

org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinBaseOperator

All Implemented Interfaces:

Serializable, Cloneable, VectorizationContextRegion, Node

Direct Known Subclasses:

VectorMapJoinOperator, VectorMapJoinOuterFilteredOperator

public class VectorMapJoinBaseOperator
extends MapJoinOperator
implements VectorizationContextRegion

The *NON-NATIVE* base vector map join operator class used by VectorMapJoinOperator and VectorMapJoinOuterFilteredOperator. It has common variables and code for the output batch, Hybrid Grace spill batch, and more.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.OperatorFunc, Operator.State

Field Summary

Fields

Modifier and Type	Field and Description
protected VectorizedRowBatch	outputBatch
protected Map<ObjectInspector,VectorAssignRowSameBatch>	outputVectorAssignRowMap
protected VectorizedRowBatch	scratchBatch
protected int	tag
protected VectorizationContext	vOutContext
protected VectorizedRowBatchCtx	vrbCtx

Fields inherited from class org.apache.hadoop.hive.ql.exec.MapJoinOperator

firstSmallTable, hashMapRowGetters, loader, mapJoinTables, spilledMapJoinTables

Fields inherited from class org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator

emptyList, joinKeys, joinKeysObjectInspectors, posBigTable

Fields inherited from class org.apache.hadoop.hive.ql.exec.CommonJoinOperator

alias, aliasFilterTags, condn, countAfterReport, dummyObj, dummyObjVectors, filterMaps, filterTags, forwardCache, heartbeatInterval, intermediate, joinFilterObjectInspectors, joinFilters, joinValues, joinValuesObjectInspectors, joinValuesStandardObjectInspectors, noOuterJoin, NOTSKIPBIGTABLE, nullsafes, numAliases, offsets, order, rowContainerStandardObjectInspectors, skipVectors, spillTableDesc, totalSz

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

childOperators, childOperatorsArray, childOperatorsTag, colExprMap, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVECOUNTERCREATEDFILES, HIVECOUNTERFATAL, id, inputObjInspectors, isLogDebugEnabled, isLogInfoEnabled, isLogTraceEnabled, operatorId, out, outputObjInspector, parentOperators, PLOG, reporter, state, statsMap

Constructor Summary

Constructors

Constructor and Description
VectorMapJoinBaseOperator()
VectorMapJoinBaseOperator(VectorizationContext vContext, OperatorDesc conf)

Method Summary

Methods

Modifier and Type	Method and Description
void	closeOp(boolean aborted) All done.
VectorizationContext	getOuputVectorizationContext()
Collection<Future<?>>	initializeOp(org.apache.hadoop.conf.Configuration hconf) Operator specific initialization.
protected void	internalForward(Object row, ObjectInspector outputOI) 'forwards' the (row-mode) record into the (vectorized) output batch
protected void	reProcessBigTable(int partitionId) For a vectorized row batch from the rows feed from the super MapJoinOperator.

Methods inherited from class org.apache.hadoop.hive.ql.exec.MapJoinOperator

cleanUpInputFileChangedOp, completeInitializationOp, endGroup, generateMapMetaData, getHashTableLoader, getName, getOperatorName, getRefKey, getType, getValueObjectInspectors, loadHashTable, process, reloadHashTable, setMapJoinKey, spillBigTableRow, startGroup

Methods inherited from class org.apache.hadoop.hive.ql.exec.CommonJoinOperator

checkAndGenObject, getFilteredValue, getFilterTag, getNextSize, getPosToAliasMap, hasFilter, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, reportProgress, setPosToAliasMap

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, flush, forward, getAdditionalCounters, getChildOperators, getChildren, getColumnExprMap, getConf, getConfiguration, getDone, getExecContext, getGroupKeyObject, getIdentifier, getInputObjInspectors, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logStats, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeChildren, removeParent, replaceChild, replaceParent, reset, resetId, resetStats, setAlias, setChildOperators, setColumnExprMap, setConf, setDone, setExecContext, setGroupKeyObject, setId, setInputContext, setInputObjInspectors, setOperatorId, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

vOutContext

protected VectorizationContext vOutContext

outputBatch

protected transient VectorizedRowBatch outputBatch

scratchBatch

protected transient VectorizedRowBatch scratchBatch

outputVectorAssignRowMap

protected transient Map<ObjectInspector,VectorAssignRowSameBatch> outputVectorAssignRowMap

vrbCtx

protected transient VectorizedRowBatchCtx vrbCtx

tag

protected transient int tag

Constructor Detail

VectorMapJoinBaseOperator

public VectorMapJoinBaseOperator()

VectorMapJoinBaseOperator

public VectorMapJoinBaseOperator(VectorizationContext vContext,
                         OperatorDesc conf)
                          throws HiveException

Throws:

HiveException

Method Detail

initializeOp

public Collection<Future<?>> initializeOp(org.apache.hadoop.conf.Configuration hconf)
                                   throws HiveException

Description copied from class: Operator

Operator specific initialization.

Overrides:

initializeOp in class MapJoinOperator

Throws:

HiveException

internalForward

protected void internalForward(Object row,
                   ObjectInspector outputOI)
                        throws HiveException

'forwards' the (row-mode) record into the (vectorized) output batch

Overrides:

internalForward in class CommonJoinOperator<MapJoinDesc>

Throws:

HiveException

closeOp

public void closeOp(boolean aborted)
             throws HiveException

Description copied from class: CommonJoinOperator

All done.

Overrides:

closeOp in class MapJoinOperator

Throws:

HiveException

reProcessBigTable

protected void reProcessBigTable(int partitionId)
                          throws HiveException

For a vectorized row batch from the rows feed from the super MapJoinOperator.

Overrides:

reProcessBigTable in class MapJoinOperator

Parameters:

partitionId - the partition from which to take out spilled big table rows

Throws:

HiveException

getOuputVectorizationContext

public VectorizationContext getOuputVectorizationContext()

Specified by:

getOuputVectorizationContext in interface VectorizationContextRegion