public class SortByShuffler extends Object implements SparkShuffler
Constructor and Description |
---|
SortByShuffler(boolean totalOrder,
SparkPlan sparkPlan) |
Modifier and Type | Method and Description |
---|---|
String |
getName() |
org.apache.spark.api.java.JavaPairRDD<HiveKey,Iterable<org.apache.hadoop.io.BytesWritable>> |
shuffle(org.apache.spark.api.java.JavaPairRDD<HiveKey,org.apache.hadoop.io.BytesWritable> input,
int numPartitions) |
public SortByShuffler(boolean totalOrder, SparkPlan sparkPlan)
totalOrder
- whether this shuffler provides total order shuffle.public org.apache.spark.api.java.JavaPairRDD<HiveKey,Iterable<org.apache.hadoop.io.BytesWritable>> shuffle(org.apache.spark.api.java.JavaPairRDD<HiveKey,org.apache.hadoop.io.BytesWritable> input, int numPartitions)
shuffle
in interface SparkShuffler
public String getName()
getName
in interface SparkShuffler
Copyright © 2016 The Apache Software Foundation. All rights reserved.