Constructor and Description |
---|
ShuffleTran(SparkPlan sparkPlan,
SparkShuffler sf,
int n) |
ShuffleTran(SparkPlan sparkPlan,
SparkShuffler sf,
int n,
boolean toCache) |
Modifier and Type | Method and Description |
---|---|
String |
getName() |
int |
getNoOfPartitions() |
SparkShuffler |
getShuffler() |
Boolean |
isCacheEnable() |
void |
setName(String name) |
org.apache.spark.api.java.JavaPairRDD<HiveKey,Iterable<org.apache.hadoop.io.BytesWritable>> |
transform(org.apache.spark.api.java.JavaPairRDD<HiveKey,org.apache.hadoop.io.BytesWritable> input) |
public ShuffleTran(SparkPlan sparkPlan, SparkShuffler sf, int n)
public ShuffleTran(SparkPlan sparkPlan, SparkShuffler sf, int n, boolean toCache)
public org.apache.spark.api.java.JavaPairRDD<HiveKey,Iterable<org.apache.hadoop.io.BytesWritable>> transform(org.apache.spark.api.java.JavaPairRDD<HiveKey,org.apache.hadoop.io.BytesWritable> input)
public int getNoOfPartitions()
public String getName()
public Boolean isCacheEnable()
isCacheEnable
in interface SparkTran<HiveKey,org.apache.hadoop.io.BytesWritable,HiveKey,Iterable<org.apache.hadoop.io.BytesWritable>>
public void setName(String name)
public SparkShuffler getShuffler()
Copyright © 2016 The Apache Software Foundation. All rights reserved.