org.apache.crunch.types.avro
Class AvroOutputFormat<T>
java.lang.Object
org.apache.hadoop.mapreduce.OutputFormat<K,V>
org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<org.apache.avro.mapred.AvroWrapper<T>,org.apache.hadoop.io.NullWritable>
org.apache.crunch.types.avro.AvroOutputFormat<T>
public class AvroOutputFormat<T>
- extends org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<org.apache.avro.mapred.AvroWrapper<T>,org.apache.hadoop.io.NullWritable>
An OutputFormat
for Avro data files.
Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat |
org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.Counter |
Method Summary |
static
<S> org.apache.avro.file.DataFileWriter<S> |
|
getDataFileWriter(org.apache.hadoop.fs.Path path,
org.apache.hadoop.conf.Configuration conf)
|
org.apache.hadoop.mapreduce.RecordWriter<org.apache.avro.mapred.AvroWrapper<T>,org.apache.hadoop.io.NullWritable> |
getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
|
Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat |
checkOutputSpecs, getCompressOutput, getDefaultWorkFile, getOutputCommitter, getOutputCompressorClass, getOutputPath, getPathForWorkFile, getUniqueFile, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputPath |
AvroOutputFormat
public AvroOutputFormat()
getDataFileWriter
public static <S> org.apache.avro.file.DataFileWriter<S> getDataFileWriter(org.apache.hadoop.fs.Path path,
org.apache.hadoop.conf.Configuration conf)
throws IOException
- Throws:
IOException
getRecordWriter
public org.apache.hadoop.mapreduce.RecordWriter<org.apache.avro.mapred.AvroWrapper<T>,org.apache.hadoop.io.NullWritable> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
throws IOException,
InterruptedException
- Specified by:
getRecordWriter
in class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<org.apache.avro.mapred.AvroWrapper<T>,org.apache.hadoop.io.NullWritable>
- Throws:
IOException
InterruptedException
Copyright © 2014 The Apache Software Foundation. All Rights Reserved.