public class VectorReduceSinkObjectHashOperator extends VectorReduceSinkCommonOperator
Operator.OperatorFunc, Operator.State
Modifier and Type | Field and Description |
---|---|
protected ByteStream.Output |
keyOutput |
protected VectorSerializeRow<BinarySortableSerializeWrite> |
keyVectorSerializeRow |
protected int[] |
reduceSinkBucketColumnMap |
protected VectorExpression[] |
reduceSinkBucketExpressions |
protected TypeInfo[] |
reduceSinkBucketTypeInfos |
protected int[] |
reduceSinkPartitionColumnMap |
protected VectorExpression[] |
reduceSinkPartitionExpressions |
protected TypeInfo[] |
reduceSinkPartitionTypeInfos |
batchCounter, keyBinarySortableSerializeWrite, keyWritable, reduceSinkKeyColumnMap, reduceSinkKeyExpressions, reduceSinkKeyTypeInfos, reduceSinkValueColumnMap, reduceSinkValueExpressions, reduceSinkValueTypeInfos, reduceSkipTag, reduceTagByte, taskName, valueBytesWritable, valueLazyBinarySerializeWrite, valueOutput, valueVectorSerializeRow, vContext, vectorDesc, vectorReduceSinkInfo
abortOp, alias, asyncInitOperations, cContext, childOperators, childOperatorsArray, childOperatorsTag, colExprMap, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVECOUNTERCREATEDFILES, HIVECOUNTERFATAL, id, indexForTezUnion, inputObjInspectors, isLogDebugEnabled, isLogInfoEnabled, isLogTraceEnabled, operatorId, outputObjInspector, parentOperators, PLOG, reporter, runTimeNumRows, state, statsMap
Modifier | Constructor and Description |
---|---|
protected |
VectorReduceSinkObjectHashOperator()
Kryo ctor.
|
|
VectorReduceSinkObjectHashOperator(CompilationOpContext ctx) |
|
VectorReduceSinkObjectHashOperator(CompilationOpContext ctx,
VectorizationContext vContext,
OperatorDesc conf) |
Modifier and Type | Method and Description |
---|---|
protected void |
initializeOp(org.apache.hadoop.conf.Configuration hconf)
Operator specific initialization.
|
void |
process(Object row,
int tag)
Process the row.
|
closeOp, collect, getIsReduceSink, getName, getOperatorName, getOuputVectorizationContext, getReduceOutputName, getType, setOutputCollector
abort, acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, cleanUpInputFileChangedOp, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, completeInitializationOp, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, endGroup, flush, forward, getAdditionalCounters, getChildOperators, getChildren, getColumnExprMap, getCompilationOpContext, getConf, getConfiguration, getDone, getExecContext, getGroupKeyObject, getIdentifier, getIndexForTezUnion, getInputObjInspectors, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logStats, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeParent, removeParents, replaceChild, replaceParent, reset, resetStats, setAlias, setChildOperators, setColumnExprMap, setCompilationOpContext, setConf, setDone, setExecContext, setGroupKeyObject, setId, setIndexForTezUnion, setInputContext, setInputObjInspectors, setOperatorId, setOpTraits, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, startGroup, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString
protected int[] reduceSinkBucketColumnMap
protected TypeInfo[] reduceSinkBucketTypeInfos
protected VectorExpression[] reduceSinkBucketExpressions
protected int[] reduceSinkPartitionColumnMap
protected TypeInfo[] reduceSinkPartitionTypeInfos
protected VectorExpression[] reduceSinkPartitionExpressions
protected transient ByteStream.Output keyOutput
protected transient VectorSerializeRow<BinarySortableSerializeWrite> keyVectorSerializeRow
protected VectorReduceSinkObjectHashOperator()
public VectorReduceSinkObjectHashOperator(CompilationOpContext ctx)
public VectorReduceSinkObjectHashOperator(CompilationOpContext ctx, VectorizationContext vContext, OperatorDesc conf) throws HiveException
HiveException
protected void initializeOp(org.apache.hadoop.conf.Configuration hconf) throws HiveException
Operator
initializeOp
in class VectorReduceSinkCommonOperator
HiveException
public void process(Object row, int tag) throws HiveException
Operator
process
in class Operator<ReduceSinkDesc>
row
- The object representing the row.tag
- The tag of the row usually means which parent this row comes from.
Rows with the same tag should have exactly the same rowInspector
all the time.HiveException
Copyright © 2021 The Apache Software Foundation. All rights reserved.