Package | Description |
---|---|
org.apache.hadoop.hive.ql.exec.spark | |
org.apache.hadoop.hive.ql.parse.spark | |
org.apache.hadoop.hive.ql.plan |
Constructor and Description |
---|
ShuffleTran(SparkPlan sparkPlan,
SparkShuffler sf,
int n,
boolean toCache,
String name,
SparkEdgeProperty edge) |
Modifier and Type | Field and Description |
---|---|
Map<ReduceSinkOperator,ObjectPair<SparkEdgeProperty,ReduceWork>> |
GenSparkProcContext.leafOpToFollowingWorkInfo |
Map<Operator<?>,Map<BaseWork,SparkEdgeProperty>> |
GenSparkProcContext.linkOpWithWorkMap |
Modifier and Type | Method and Description |
---|---|
static SparkEdgeProperty |
GenSparkUtils.getEdgeProperty(HiveConf conf,
ReduceSinkOperator reduceSink,
ReduceWork reduceWork) |
Modifier and Type | Field and Description |
---|---|
SparkEdgeProperty |
SparkWork.Dependency.prop |
Modifier and Type | Field and Description |
---|---|
protected Map<org.apache.commons.lang3.tuple.Pair<BaseWork,BaseWork>,SparkEdgeProperty> |
SparkWork.edgeProperties |
Modifier and Type | Method and Description |
---|---|
SparkEdgeProperty |
SparkWork.getEdgeProperty(BaseWork a,
BaseWork b)
returns the edge type connecting work a and b
|
Modifier and Type | Method and Description |
---|---|
void |
SparkWork.connect(BaseWork a,
BaseWork b,
SparkEdgeProperty edgeProp)
connect adds an edge between a and b.
|
Copyright © 2022 The Apache Software Foundation. All rights reserved.