Modifier and Type | Class and Description |
---|---|
class |
VectorReduceSinkOperator |
Modifier and Type | Method and Description |
---|---|
static ObjectPair<List<ReduceSinkOperator>,Map<Byte,List<ExprNodeDesc>>> |
MapJoinProcessor.getKeys(boolean leftInputJoin,
String[] baseSrc,
JoinOperator op) |
Modifier and Type | Method and Description |
---|---|
static void |
GenMapRedUtils.initPlan(ReduceSinkOperator op,
GenMRProcContext opProcCtx)
Initialize the current plan by adding it to root tasks.
|
static void |
GenMapRedUtils.initUnionPlan(ReduceSinkOperator op,
UnionOperator currUnionOp,
GenMRProcContext opProcCtx,
Task<? extends Serializable> unionTask)
Initialize the current union plan.
|
static Object |
ReduceSinkMapJoinProc.processReduceSinkToHashJoin(ReduceSinkOperator parentRS,
MapJoinOperator mapJoinOp,
GenTezProcContext context) |
static void |
GenMapRedUtils.setKeyAndValueDesc(ReduceWork work,
ReduceSinkOperator rs)
Set key and value descriptor
|
Modifier and Type | Method and Description |
---|---|
static List<ReduceSinkOperator> |
CorrelationUtilities.findSiblingReduceSinkOperators(ReduceSinkOperator op)
Find all sibling ReduceSinkOperators (which have the same child operator of op) of op (op
included).
|
Set<ReduceSinkOperator> |
IntraQueryCorrelation.getAllReduceSinkOperators() |
List<ReduceSinkOperator> |
IntraQueryCorrelation.getBottomReduceSinkOperators() |
Modifier and Type | Method and Description |
---|---|
void |
IntraQueryCorrelation.addToAllReduceSinkOperators(ReduceSinkOperator rsop) |
void |
CorrelationOptimizer.CorrelationNodeProcCtx.addWalked(ReduceSinkOperator op) |
protected boolean |
ReduceSinkDeDuplication.AbsctractReducerReducerProc.aggressiveDedup(ReduceSinkOperator cRS,
ReduceSinkOperator pRS,
ReduceSinkDeDuplication.ReduceSinkDeduplicateProcCtx dedupCtx) |
static List<ReduceSinkOperator> |
CorrelationUtilities.findSiblingReduceSinkOperators(ReduceSinkOperator op)
Find all sibling ReduceSinkOperators (which have the same child operator of op) of op (op
included).
|
protected static Operator<?> |
CorrelationUtilities.getStartForGroupBy(ReduceSinkOperator cRS,
ReduceSinkDeDuplication.ReduceSinkDeduplicateProcCtx dedupCtx) |
protected static boolean |
CorrelationUtilities.hasGroupingSet(ReduceSinkOperator cRS) |
boolean |
CorrelationOptimizer.CorrelationNodeProcCtx.isWalked(ReduceSinkOperator op) |
protected boolean |
ReduceSinkDeDuplication.AbsctractReducerReducerProc.merge(ReduceSinkOperator cRS,
JoinOperator pJoin,
int minReducer) |
protected boolean |
ReduceSinkDeDuplication.AbsctractReducerReducerProc.merge(ReduceSinkOperator cRS,
ReduceSinkOperator pRS,
int minReducer)
Current RSDedup remove/replace child RS.
|
protected abstract Object |
ReduceSinkDeDuplication.AbsctractReducerReducerProc.process(ReduceSinkOperator cRS,
GroupByOperator cGBY,
ReduceSinkDeDuplication.ReduceSinkDeduplicateProcCtx dedupCtx) |
protected abstract Object |
ReduceSinkDeDuplication.AbsctractReducerReducerProc.process(ReduceSinkOperator cRS,
ReduceSinkDeDuplication.ReduceSinkDeduplicateProcCtx dedupCtx) |
protected static void |
CorrelationUtilities.removeReduceSinkForGroupBy(ReduceSinkOperator cRS,
GroupByOperator cGBYr,
ParseContext context,
org.apache.hadoop.hive.ql.optimizer.correlation.AbstractCorrelationProcCtx procCtx) |
void |
CorrelationOptimizer.CorrelationNodeProcCtx.removeWalked(ReduceSinkOperator op) |
protected static SelectOperator |
CorrelationUtilities.replaceReduceSinkWithSelectOperator(ReduceSinkOperator childRS,
ParseContext context,
org.apache.hadoop.hive.ql.optimizer.correlation.AbstractCorrelationProcCtx procCtx) |
Modifier and Type | Method and Description |
---|---|
void |
CorrelationOptimizer.CorrelationNodeProcCtx.addWalkedAll(Collection<ReduceSinkOperator> c) |
void |
CorrelationOptimizer.CorrelationNodeProcCtx.removeWalkedAll(Collection<ReduceSinkOperator> c) |
void |
IntraQueryCorrelation.setJobFlowCorrelation(boolean jobFlowCorrelation,
List<ReduceSinkOperator> bottomReduceSinkOperators) |
Modifier and Type | Method and Description |
---|---|
protected void |
BucketingSortingOpProcFactory.GroupByInferrer.processGroupByReduceSink(ReduceSinkOperator rop,
GroupByOperator gop,
BucketingSortingCtx bctx)
Process the ReduceSinkOperator preceding a GroupByOperator to determine which columns
are bucketed and sorted.
|
Modifier and Type | Field and Description |
---|---|
Set<ReduceSinkOperator> |
GenTezProcContext.clonedReduceSinks |
Set<ReduceSinkOperator> |
GenTezProcContext.connectedReduceSinks |
Map<BaseWork,List<ReduceSinkOperator>> |
GenTezProcContext.linkWorkWithReduceSinkMap |
Map<MapJoinOperator,Set<ReduceSinkOperator>> |
GenTezProcContext.mapJoinToUnprocessedSmallTableReduceSinks |
Set<ReduceSinkOperator> |
OptimizeTezProcContext.visitedReduceSinks |
Modifier and Type | Method and Description |
---|---|
List<ReduceSinkOperator> |
ParseContext.getReduceSinkOperatorsAddedByEnforceBucketingSorting() |
Map<ReduceSinkOperator,TableScanOperator> |
ParseContext.getRsOpToTsOpMap() |
Map<ReduceSinkOperator,RuntimeValuesInfo> |
ParseContext.getRsToRuntimeValuesInfoMap() |
Modifier and Type | Method and Description |
---|---|
static TezEdgeProperty.EdgeType |
GenTezUtils.determineEdgeType(BaseWork preceedingWork,
BaseWork followingWork,
ReduceSinkOperator reduceSinkOperator) |
static void |
GenTezUtils.processDynamicMinMaxPushDownOperator(GenTezProcContext procCtx,
RuntimeValuesInfo runtimeValuesInfo,
ReduceSinkOperator rs) |
static void |
GenTezUtils.removeSemiJoinOperator(ParseContext context,
ReduceSinkOperator rs,
TableScanOperator ts) |
Modifier and Type | Method and Description |
---|---|
void |
ParseContext.setReduceSinkOperatorsAddedByEnforceBucketingSorting(List<ReduceSinkOperator> reduceSinkOperatorsAddedByEnforceBucketingSorting) |
void |
ParseContext.setRsOpToTsOpMap(Map<ReduceSinkOperator,TableScanOperator> rsOpToTsOpMap) |
void |
ParseContext.setRsToRuntimeValuesInfoMap(Map<ReduceSinkOperator,RuntimeValuesInfo> rsToRuntimeValuesInfo) |
Modifier and Type | Field and Description |
---|---|
Map<ReduceSinkOperator,ObjectPair<SparkEdgeProperty,ReduceWork>> |
GenSparkProcContext.leafOpToFollowingWorkInfo |
Map<BaseWork,List<ReduceSinkOperator>> |
GenSparkProcContext.linkWorkWithReduceSinkMap |
Modifier and Type | Method and Description |
---|---|
Set<ReduceSinkOperator> |
OptimizeSparkProcContext.getVisitedReduceSinks() |
Modifier and Type | Method and Description |
---|---|
static SparkEdgeProperty |
GenSparkUtils.getEdgeProperty(ReduceSinkOperator reduceSink,
ReduceWork reduceWork) |
protected void |
GenSparkUtils.setupReduceSink(GenSparkProcContext context,
ReduceWork reduceWork,
ReduceSinkOperator reduceSink) |
Copyright © 2021 The Apache Software Foundation. All rights reserved.