public class VectorMapJoinOperator extends VectorMapJoinBaseOperator
Operator.OperatorFunc, Operator.State
Modifier and Type | Field and Description |
---|---|
protected VectorExpression[] |
bigTableFilterExpressions |
protected VectorExpression[] |
bigTableValueExpressions |
protected VectorExpression[] |
keyExpressions |
protected Object[] |
singleRow |
outputBatch, outputVectorAssignRowMap, scratchBatch, tag, vOutContext, vrbCtx
firstSmallTable, hashMapRowGetters, loader, mapJoinTables, spilledMapJoinTables
emptyList, joinKeys, joinKeysObjectInspectors, posBigTable
alias, aliasFilterTags, condn, countAfterReport, dummyObj, dummyObjVectors, filterMaps, filterTags, forwardCache, heartbeatInterval, intermediate, joinFilterObjectInspectors, joinFilters, joinValues, joinValuesObjectInspectors, joinValuesStandardObjectInspectors, noOuterJoin, NOTSKIPBIGTABLE, nullsafes, numAliases, offsets, order, rowContainerStandardObjectInspectors, skipVectors, spillTableDesc, totalSz
abortOp, asyncInitOperations, cContext, childOperators, childOperatorsArray, childOperatorsTag, colExprMap, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVECOUNTERCREATEDFILES, HIVECOUNTERFATAL, id, inputObjInspectors, isLogDebugEnabled, isLogInfoEnabled, isLogTraceEnabled, operatorId, out, outputObjInspector, parentOperators, PLOG, reporter, state, statsMap
Constructor and Description |
---|
VectorMapJoinOperator()
Kryo ctor.
|
VectorMapJoinOperator(CompilationOpContext ctx) |
VectorMapJoinOperator(CompilationOpContext ctx,
VectorizationContext vContext,
OperatorDesc conf) |
Modifier and Type | Method and Description |
---|---|
void |
initializeOp(org.apache.hadoop.conf.Configuration hconf)
Operator specific initialization.
|
void |
process(Object row,
int tag)
Process the row.
|
protected JoinUtil.JoinResult |
setMapJoinKey(MapJoinTableContainer.ReusableGetAdaptor dest,
Object row,
byte alias) |
protected void |
spillBigTableRow(MapJoinTableContainer hybridHtContainer,
Object row)
Postpone processing the big table row temporarily by spilling it to a row container
|
closeOp, getOuputVectorizationContext, internalForward, reProcessBigTable
canSkipJoinProcessing, canSkipReload, cleanUpInputFileChangedOp, completeInitializationOp, endGroup, generateMapMetaData, getHashTableLoader, getName, getOperatorName, getRefKey, getType, getValueObjectInspectors, isInputFileChangeSensitive, loadHashTable, reloadHashTable, startGroup
checkAndGenObject, getFilteredValue, getFilterTag, getNextSize, getPosToAliasMap, hasFilter, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, reportProgress, setPosToAliasMap
abort, acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, flush, forward, getAdditionalCounters, getChildOperators, getChildren, getColumnExprMap, getCompilationOpContext, getConf, getConfiguration, getDone, getExecContext, getGroupKeyObject, getIdentifier, getInputObjInspectors, getIsReduceSink, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getReduceOutputName, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logStats, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeParent, removeParents, replaceChild, replaceParent, reset, resetStats, setAlias, setChildOperators, setColumnExprMap, setCompilationOpContext, setConf, setDone, setExecContext, setGroupKeyObject, setId, setInputContext, setInputObjInspectors, setOperatorId, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString
protected VectorExpression[] keyExpressions
protected VectorExpression[] bigTableFilterExpressions
protected VectorExpression[] bigTableValueExpressions
protected transient Object[] singleRow
public VectorMapJoinOperator()
public VectorMapJoinOperator(CompilationOpContext ctx)
public VectorMapJoinOperator(CompilationOpContext ctx, VectorizationContext vContext, OperatorDesc conf) throws HiveException
HiveException
public void initializeOp(org.apache.hadoop.conf.Configuration hconf) throws HiveException
Operator
initializeOp
in class VectorMapJoinBaseOperator
HiveException
protected JoinUtil.JoinResult setMapJoinKey(MapJoinTableContainer.ReusableGetAdaptor dest, Object row, byte alias) throws HiveException
setMapJoinKey
in class MapJoinOperator
HiveException
public void process(Object row, int tag) throws HiveException
Operator
process
in class MapJoinOperator
row
- The object representing the row.tag
- The tag of the row usually means which parent this row comes from.
Rows with the same tag should have exactly the same rowInspector
all the time.HiveException
protected void spillBigTableRow(MapJoinTableContainer hybridHtContainer, Object row) throws HiveException
MapJoinOperator
spillBigTableRow
in class MapJoinOperator
hybridHtContainer
- Hybrid hashtable containerrow
- big table rowHiveException
Copyright © 2016 The Apache Software Foundation. All rights reserved.