org.apache.crunch.io
Class CrunchOutputs<K,V>
java.lang.Object
org.apache.crunch.io.CrunchOutputs<K,V>
public class CrunchOutputs<K,V>
- extends Object
An analogue of CrunchInputs
for handling multiple OutputFormat
instances
writing to multiple files within a single MapReduce job.
Constructor Summary |
CrunchOutputs(org.apache.hadoop.mapreduce.TaskInputOutputContext<?,?,K,V> context)
Creates and initializes multiple outputs support,
it should be instantiated in the Mapper/Reducer setup method. |
Method Summary |
static void |
addNamedOutput(org.apache.hadoop.mapreduce.Job job,
String name,
Class<? extends org.apache.hadoop.mapreduce.OutputFormat> outputFormatClass,
Class keyClass,
Class valueClass)
|
static void |
addNamedOutput(org.apache.hadoop.mapreduce.Job job,
String name,
FormatBundle<? extends org.apache.hadoop.mapreduce.OutputFormat> outputBundle,
Class keyClass,
Class valueClass)
|
void |
close()
|
void |
write(String namedOutput,
K key,
V value)
|
CRUNCH_OUTPUTS
public static final String CRUNCH_OUTPUTS
- See Also:
- Constant Field Values
CRUNCH_DISABLE_OUTPUT_COUNTERS
public static final String CRUNCH_DISABLE_OUTPUT_COUNTERS
- See Also:
- Constant Field Values
CrunchOutputs
public CrunchOutputs(org.apache.hadoop.mapreduce.TaskInputOutputContext<?,?,K,V> context)
- Creates and initializes multiple outputs support,
it should be instantiated in the Mapper/Reducer setup method.
- Parameters:
context
- the TaskInputOutputContext object
addNamedOutput
public static void addNamedOutput(org.apache.hadoop.mapreduce.Job job,
String name,
Class<? extends org.apache.hadoop.mapreduce.OutputFormat> outputFormatClass,
Class keyClass,
Class valueClass)
addNamedOutput
public static void addNamedOutput(org.apache.hadoop.mapreduce.Job job,
String name,
FormatBundle<? extends org.apache.hadoop.mapreduce.OutputFormat> outputBundle,
Class keyClass,
Class valueClass)
write
public void write(String namedOutput,
K key,
V value)
throws IOException,
InterruptedException
- Throws:
IOException
InterruptedException
close
public void close()
throws IOException,
InterruptedException
- Throws:
IOException
InterruptedException
Copyright © 2014 The Apache Software Foundation. All Rights Reserved.