org.apache.crunch.lib.sort

Class TotalOrderPartitioner<K,V>

java.lang.Object

org.apache.hadoop.mapreduce.Partitioner<K,V>

org.apache.crunch.lib.sort.TotalOrderPartitioner<K,V>

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class TotalOrderPartitioner<K,V>
extends org.apache.hadoop.mapreduce.Partitioner<K,V>
implements org.apache.hadoop.conf.Configurable

A partition-aware Partitioner instance that can work with either Avro or Writable-formatted keys.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TotalOrderPartitioner.BinarySearchNode<K>
static interface	TotalOrderPartitioner.Node<T> Interface to the partitioner to locate a key in the partition keyset.

Field Summary

Fields

Modifier and Type	Field and Description
static String	DEFAULT_PATH
static String	PARTITIONER_PATH

Constructor Summary

Constructors

Constructor and Description
TotalOrderPartitioner()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.conf.Configuration	getConf()
int	getPartition(K key, V value, int modulo)
static String	getPartitionFile(org.apache.hadoop.conf.Configuration conf)
void	setConf(org.apache.hadoop.conf.Configuration conf)
static void	setPartitionFile(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path p)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_PATH

public static final String DEFAULT_PATH

See Also:

Constant Field Values

PARTITIONER_PATH

public static final String PARTITIONER_PATH

See Also:

Constant Field Values

Constructor Detail

TotalOrderPartitioner

public TotalOrderPartitioner()

Method Detail

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

getPartition

public int getPartition(K key,
                        V value,
                        int modulo)

Specified by:

getPartition in class org.apache.hadoop.mapreduce.Partitioner<K,V>

setPartitionFile

public static void setPartitionFile(org.apache.hadoop.conf.Configuration conf,
                                    org.apache.hadoop.fs.Path p)

getPartitionFile

public static String getPartitionFile(org.apache.hadoop.conf.Configuration conf)