public class PairMapFn<K,V,S,T> extends MapFn<Pair<K,V>,Pair<S,T>>
Constructor and Description |
---|
PairMapFn(MapFn<K,S> keys,
MapFn<V,T> values) |
Modifier and Type | Method and Description |
---|---|
void |
cleanup(Emitter<Pair<S,T>> emitter)
Called during the cleanup of the MapReduce job this
DoFn is
associated with. |
void |
configure(org.apache.hadoop.conf.Configuration conf)
Configure this DoFn.
|
void |
initialize()
Initialize this DoFn.
|
Pair<S,T> |
map(Pair<K,V> input)
Maps the given input into an instance of the output type.
|
void |
setConfiguration(org.apache.hadoop.conf.Configuration conf)
Called during the setup of an initialized
PType that
relies on this instance. |
void |
setContext(org.apache.hadoop.mapreduce.TaskInputOutputContext<?,?,?,?> context)
Called during setup to pass the
TaskInputOutputContext to this
DoFn instance. |
process, scaleFactor
disableDeepCopy
public void configure(org.apache.hadoop.conf.Configuration conf)
DoFn
Called during the job planning phase by the crunch-client.
public void setConfiguration(org.apache.hadoop.conf.Configuration conf)
DoFn
PType
that
relies on this instance.public void setContext(org.apache.hadoop.mapreduce.TaskInputOutputContext<?,?,?,?> context)
DoFn
TaskInputOutputContext
to this
DoFn
instance. The specified TaskInputOutputContext
must not be null.public void initialize()
DoFn
DoFn.process(Object, Emitter)
is triggered. Subclasses may override
this method to do appropriate initialization.
Called during the setup of the job instance this DoFn
is associated
with.
public Pair<S,T> map(Pair<K,V> input)
MapFn
Copyright © 2015 The Apache Software Foundation. All Rights Reserved.