public class SortByShuffler extends Object implements SparkShuffler<org.apache.hadoop.io.BytesWritable>
Constructor and Description |
---|
SortByShuffler(boolean totalOrder,
SparkPlan sparkPlan,
org.apache.spark.serializer.KryoSerializer shuffleSerializer) |
Modifier and Type | Method and Description |
---|---|
String |
getName() |
org.apache.spark.api.java.JavaPairRDD<HiveKey,org.apache.hadoop.io.BytesWritable> |
shuffle(org.apache.spark.api.java.JavaPairRDD<HiveKey,org.apache.hadoop.io.BytesWritable> input,
int numPartitions) |
public SortByShuffler(boolean totalOrder, SparkPlan sparkPlan, org.apache.spark.serializer.KryoSerializer shuffleSerializer)
totalOrder
- whether this shuffler provides total order shuffle.public org.apache.spark.api.java.JavaPairRDD<HiveKey,org.apache.hadoop.io.BytesWritable> shuffle(org.apache.spark.api.java.JavaPairRDD<HiveKey,org.apache.hadoop.io.BytesWritable> input, int numPartitions)
shuffle
in interface SparkShuffler<org.apache.hadoop.io.BytesWritable>
public String getName()
getName
in interface SparkShuffler<org.apache.hadoop.io.BytesWritable>
Copyright © 2022 The Apache Software Foundation. All rights reserved.