public class VectorPTFOperator extends Operator<PTFDesc> implements VectorizationOperator, VectorizationContextRegion
Operator.Counter, Operator.OperatorFunc, Operator.State
Modifier and Type | Field and Description |
---|---|
protected VectorizationContext |
vOutContext |
abortOp, alias, asyncInitOperations, bucketingVersion, cContext, childOperators, childOperatorsArray, childOperatorsTag, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVE_COUNTER_CREATED_DYNAMIC_PARTITIONS, HIVE_COUNTER_CREATED_FILES, HIVE_COUNTER_FATAL, id, indexForTezUnion, inputObjInspectors, numRows, operatorId, out, outputObjInspector, parentOperators, reporter, runTimeNumRows, state, statsMap
Modifier | Constructor and Description |
---|---|
protected |
VectorPTFOperator()
Kryo ctor.
|
|
VectorPTFOperator(CompilationOpContext ctx) |
|
VectorPTFOperator(CompilationOpContext ctx,
OperatorDesc conf,
VectorizationContext vContext,
VectorDesc vectorDesc) |
Modifier and Type | Method and Description |
---|---|
protected void |
closeOp(boolean abort)
Operator specific close routine.
|
void |
forward(Object row,
ObjectInspector rowInspector) |
VectorizationContext |
getInputVectorizationContext() |
String |
getName()
Gets the name of the node.
|
static String |
getOperatorName() |
VectorizationContext |
getOutputVectorizationContext() |
OperatorType |
getType()
Return the type of the specific operator among the
types in OperatorType.
|
VectorDesc |
getVectorDesc() |
protected void |
initializeOp(org.apache.hadoop.conf.Configuration hconf)
Operator specific initialization.
|
void |
process(Object row,
int tag)
We are processing a batch from reduce processor that is only for one reducer key or PTF group.
|
void |
setNextVectorBatchGroupStatus(boolean isLastGroupBatch) |
protected org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch |
setupOverflowBatch() |
protected void |
setupVOutContext()
Setup the vectorized row batch description of the output of the native vectorized PTF
operator.
|
abort, acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, cleanUpInputFileChangedOp, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, completeInitializationOp, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, endGroup, flush, flushRecursive, forward, forward, getAdditionalCounters, getBucketingVersion, getChildOperators, getChildren, getColumnExprMap, getCompilationOpContext, getConf, getConfiguration, getCounterName, getDone, getExecContext, getGroupKeyObject, getIdentifier, getIndexForTezUnion, getInputObjInspectors, getIsReduceSink, getMarker, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getReduceOutputName, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logicalEquals, logicalEqualsTree, logStats, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeParent, removeParents, replaceChild, replaceParent, reset, setAlias, setBucketingVersion, setChildOperators, setColumnExprMap, setCompilationOpContext, setConf, setDone, setExecContext, setGroupKeyObject, setIndexForTezUnion, setInputContext, setInputObjInspectors, setMarker, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, startGroup, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString
protected VectorizationContext vOutContext
protected VectorPTFOperator()
public VectorPTFOperator(CompilationOpContext ctx)
public VectorPTFOperator(CompilationOpContext ctx, OperatorDesc conf, VectorizationContext vContext, VectorDesc vectorDesc) throws HiveException
HiveException
protected void setupVOutContext()
protected org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch setupOverflowBatch() throws HiveException
HiveException
protected void initializeOp(org.apache.hadoop.conf.Configuration hconf) throws HiveException
Operator
initializeOp
in class Operator<PTFDesc>
HiveException
public void setNextVectorBatchGroupStatus(boolean isLastGroupBatch) throws HiveException
setNextVectorBatchGroupStatus
in class Operator<PTFDesc>
HiveException
public void process(Object row, int tag) throws HiveException
process
in class Operator<PTFDesc>
row
- The object representing the row.tag
- The tag of the row usually means which parent this row comes from.
Rows with the same tag should have exactly the same rowInspector
all the time.HiveException
public void forward(Object row, ObjectInspector rowInspector) throws HiveException
forward
in class Operator<PTFDesc>
HiveException
protected void closeOp(boolean abort) throws HiveException
Operator
closeOp
in class Operator<PTFDesc>
HiveException
public String getName()
Node
public static String getOperatorName()
public OperatorType getType()
Operator
public VectorizationContext getOutputVectorizationContext()
getOutputVectorizationContext
in interface VectorizationContextRegion
public VectorizationContext getInputVectorizationContext()
getInputVectorizationContext
in interface VectorizationOperator
public VectorDesc getVectorDesc()
getVectorDesc
in interface VectorizationOperator
Copyright © 2022 The Apache Software Foundation. All rights reserved.