Modifier and Type | Class and Description |
---|---|
class |
VectorReduceSinkOperator |
Modifier and Type | Method and Description |
---|---|
static ObjectPair<List<ReduceSinkOperator>,Map<Byte,List<ExprNodeDesc>>> |
MapJoinProcessor.getKeys(boolean leftInputJoin,
String[] baseSrc,
JoinOperator op) |
Modifier and Type | Method and Description |
---|---|
protected int |
CountDistinctRewriteProc.CountDistinctProcessor.checkCountDistinct(GroupByOperator mGby,
ReduceSinkOperator rs,
GroupByOperator rGby) |
static void |
GenMapRedUtils.initPlan(ReduceSinkOperator op,
GenMRProcContext opProcCtx)
Initialize the current plan by adding it to root tasks.
|
static void |
GenMapRedUtils.initUnionPlan(ReduceSinkOperator op,
UnionOperator currUnionOp,
GenMRProcContext opProcCtx,
Task<? extends Serializable> unionTask)
Initialize the current union plan.
|
protected void |
CountDistinctRewriteProc.CountDistinctProcessor.processGroupBy(GroupByOperator mGby,
ReduceSinkOperator rs,
GroupByOperator rGby,
int indexOfDist) |
static Object |
ReduceSinkMapJoinProc.processReduceSinkToHashJoin(ReduceSinkOperator parentRS,
MapJoinOperator mapJoinOp,
GenTezProcContext context) |
static void |
GenMapRedUtils.setKeyAndValueDesc(ReduceWork work,
ReduceSinkOperator rs)
Set key and value descriptor
|
Modifier and Type | Method and Description |
---|---|
static List<ReduceSinkOperator> |
CorrelationUtilities.findSiblingReduceSinkOperators(ReduceSinkOperator op)
Find all sibling ReduceSinkOperators (which have the same child operator of op) of op (op
included).
|
Set<ReduceSinkOperator> |
IntraQueryCorrelation.getAllReduceSinkOperators() |
List<ReduceSinkOperator> |
IntraQueryCorrelation.getBottomReduceSinkOperators() |
Modifier and Type | Method and Description |
---|---|
void |
IntraQueryCorrelation.addToAllReduceSinkOperators(ReduceSinkOperator rsop) |
void |
CorrelationOptimizer.CorrelationNodeProcCtx.addWalked(ReduceSinkOperator op) |
protected static boolean |
ReduceSinkDeDuplicationUtils.aggressiveDedup(ReduceSinkOperator cRS,
ReduceSinkOperator pRS,
ReduceSinkDeDuplication.ReduceSinkDeduplicateProcCtx dedupCtx) |
static List<ReduceSinkOperator> |
CorrelationUtilities.findSiblingReduceSinkOperators(ReduceSinkOperator op)
Find all sibling ReduceSinkOperators (which have the same child operator of op) of op (op
included).
|
protected static Operator<?> |
CorrelationUtilities.getStartForGroupBy(ReduceSinkOperator cRS,
ReduceSinkDeDuplication.ReduceSinkDeduplicateProcCtx dedupCtx) |
protected static boolean |
CorrelationUtilities.hasGroupingSet(ReduceSinkOperator cRS) |
boolean |
CorrelationOptimizer.CorrelationNodeProcCtx.isWalked(ReduceSinkOperator op) |
static boolean |
ReduceSinkDeDuplicationUtils.merge(ReduceSinkOperator cRS,
JoinOperator pJoin,
int minReducer) |
static boolean |
ReduceSinkDeDuplicationUtils.merge(ReduceSinkOperator cRS,
ReduceSinkOperator pRS,
int minReducer)
Current RSDedup remove/replace child RS.
|
protected abstract Object |
ReduceSinkDeDuplication.AbsctractReducerReducerProc.process(ReduceSinkOperator cRS,
GroupByOperator cGBY,
ReduceSinkDeDuplication.ReduceSinkDeduplicateProcCtx dedupCtx) |
protected abstract Object |
ReduceSinkDeDuplication.AbsctractReducerReducerProc.process(ReduceSinkOperator cRS,
ReduceSinkDeDuplication.ReduceSinkDeduplicateProcCtx dedupCtx) |
protected static void |
CorrelationUtilities.removeReduceSinkForGroupBy(ReduceSinkOperator cRS,
GroupByOperator cGBYr,
ParseContext context,
org.apache.hadoop.hive.ql.optimizer.correlation.AbstractCorrelationProcCtx procCtx) |
void |
CorrelationOptimizer.CorrelationNodeProcCtx.removeWalked(ReduceSinkOperator op) |
protected static SelectOperator |
CorrelationUtilities.replaceReduceSinkWithSelectOperator(ReduceSinkOperator childRS,
ParseContext context,
org.apache.hadoop.hive.ql.optimizer.correlation.AbstractCorrelationProcCtx procCtx) |
static boolean |
ReduceSinkDeDuplicationUtils.strictMerge(ReduceSinkOperator cRS,
List<ReduceSinkOperator> pRSs) |
static boolean |
ReduceSinkDeDuplicationUtils.strictMerge(ReduceSinkOperator cRS,
ReduceSinkOperator pRS)
This is a more strict version of the merge check, where:
- cRS and pRS should have exactly the same keys in the same positions, and
- cRS and pRS should have exactly the same partition columns in the same positions, and
- cRS and pRS should have exactly the same bucket columns in the same positions, and
- cRS and pRS should sort in the same direction
|
Modifier and Type | Method and Description |
---|---|
void |
CorrelationOptimizer.CorrelationNodeProcCtx.addWalkedAll(Collection<ReduceSinkOperator> c) |
void |
CorrelationOptimizer.CorrelationNodeProcCtx.removeWalkedAll(Collection<ReduceSinkOperator> c) |
void |
IntraQueryCorrelation.setJobFlowCorrelation(boolean jobFlowCorrelation,
List<ReduceSinkOperator> bottomReduceSinkOperators) |
static boolean |
ReduceSinkDeDuplicationUtils.strictMerge(ReduceSinkOperator cRS,
List<ReduceSinkOperator> pRSs) |
Modifier and Type | Method and Description |
---|---|
protected void |
BucketingSortingOpProcFactory.GroupByInferrer.processGroupByReduceSink(ReduceSinkOperator rop,
GroupByOperator gop,
BucketingSortingCtx bctx)
Process the ReduceSinkOperator preceding a GroupByOperator to determine which columns
are bucketed and sorted.
|
Modifier and Type | Field and Description |
---|---|
ReduceSinkOperator |
GenTezUtils.DynamicListContext.generator |
Modifier and Type | Field and Description |
---|---|
Set<ReduceSinkOperator> |
GenTezProcContext.clonedReduceSinks |
Set<ReduceSinkOperator> |
GenTezProcContext.connectedReduceSinks |
Map<BaseWork,List<ReduceSinkOperator>> |
GenTezProcContext.linkWorkWithReduceSinkMap |
Map<MapJoinOperator,Set<ReduceSinkOperator>> |
GenTezProcContext.mapJoinToUnprocessedSmallTableReduceSinks |
Set<ReduceSinkOperator> |
OptimizeTezProcContext.visitedReduceSinks |
Modifier and Type | Method and Description |
---|---|
List<ReduceSinkOperator> |
ParseContext.getReduceSinkOperatorsAddedByEnforceBucketingSorting() |
Map<ReduceSinkOperator,RuntimeValuesInfo> |
ParseContext.getRsToRuntimeValuesInfoMap() |
Map<ReduceSinkOperator,SemiJoinBranchInfo> |
ParseContext.getRsToSemiJoinBranchInfo() |
Modifier and Type | Method and Description |
---|---|
void |
GenTezUtils.DynamicPartitionPrunerContext.addDynamicList(ExprNodeDynamicListDesc desc,
ExprNodeDesc parent,
ExprNodeDesc grandParent,
ReduceSinkOperator generator) |
static TezEdgeProperty.EdgeType |
GenTezUtils.determineEdgeType(BaseWork preceedingWork,
BaseWork followingWork,
ReduceSinkOperator reduceSinkOperator) |
static void |
GenTezUtils.processDynamicSemiJoinPushDownOperator(GenTezProcContext procCtx,
RuntimeValuesInfo runtimeValuesInfo,
ReduceSinkOperator rs) |
static void |
GenTezUtils.removeSemiJoinOperator(ParseContext context,
ReduceSinkOperator rs,
TableScanOperator ts) |
Modifier and Type | Method and Description |
---|---|
void |
ParseContext.setReduceSinkOperatorsAddedByEnforceBucketingSorting(List<ReduceSinkOperator> reduceSinkOperatorsAddedByEnforceBucketingSorting) |
void |
ParseContext.setRsToRuntimeValuesInfoMap(Map<ReduceSinkOperator,RuntimeValuesInfo> rsToRuntimeValuesInfo) |
void |
ParseContext.setRsToSemiJoinBranchInfo(Map<ReduceSinkOperator,SemiJoinBranchInfo> rsToSemiJoinBranchInfo) |
Constructor and Description |
---|
DynamicListContext(ExprNodeDynamicListDesc desc,
ExprNodeDesc parent,
ExprNodeDesc grandParent,
ReduceSinkOperator generator) |
Modifier and Type | Field and Description |
---|---|
Map<ReduceSinkOperator,ObjectPair<SparkEdgeProperty,ReduceWork>> |
GenSparkProcContext.leafOpToFollowingWorkInfo |
Map<BaseWork,List<ReduceSinkOperator>> |
GenSparkProcContext.linkWorkWithReduceSinkMap |
Modifier and Type | Method and Description |
---|---|
Set<ReduceSinkOperator> |
OptimizeSparkProcContext.getVisitedReduceSinks() |
Modifier and Type | Method and Description |
---|---|
static SparkEdgeProperty |
GenSparkUtils.getEdgeProperty(HiveConf conf,
ReduceSinkOperator reduceSink,
ReduceWork reduceWork) |
protected void |
GenSparkUtils.setupReduceSink(GenSparkProcContext context,
ReduceWork reduceWork,
ReduceSinkOperator reduceSink) |
Modifier and Type | Method and Description |
---|---|
ReduceSinkOperator |
DynamicPruningEventDesc.getGenerator() |
Modifier and Type | Method and Description |
---|---|
void |
DynamicPruningEventDesc.setGenerator(ReduceSinkOperator generator) |
Copyright © 2022 The Apache Software Foundation. All rights reserved.