org.apache.hive.hcatalog.rcfile

Class RCFileMapReduceOutputFormat

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<K,V>

org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<org.apache.hadoop.io.WritableComparable<?>,BytesRefArrayWritable>

org.apache.hive.hcatalog.rcfile.RCFileMapReduceOutputFormat

public class RCFileMapReduceOutputFormat
extends org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<org.apache.hadoop.io.WritableComparable<?>,BytesRefArrayWritable>

The RC file input format using new Hadoop mapreduce APIs.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.Counter

Field Summary

Fields inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

BASE_OUTPUT_NAME, COMPRESS, COMPRESS_CODEC, COMPRESS_TYPE, OUTDIR, PART

Constructor Summary

Constructors

Constructor and Description
RCFileMapReduceOutputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.WritableComparable<?>,BytesRefArrayWritable>	getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext task)
static void	setColumnNumber(org.apache.hadoop.conf.Configuration conf, int columnNum) Set number of columns into the given configuration.

Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

checkOutputSpecs, getCompressOutput, getDefaultWorkFile, getOutputCommitter, getOutputCompressorClass, getOutputName, getOutputPath, getPathForWorkFile, getUniqueFile, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputName, setOutputPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RCFileMapReduceOutputFormat

public RCFileMapReduceOutputFormat()

Method Detail

setColumnNumber

public static void setColumnNumber(org.apache.hadoop.conf.Configuration conf,
                   int columnNum)

Set number of columns into the given configuration.

Parameters:

conf - configuration instance which need to set the column number

columnNum - column number for RCFile's Writer

getRecordWriter

public org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.WritableComparable<?>,BytesRefArrayWritable> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext task)
                                                                                                                           throws IOException,
                                                                                                                                  InterruptedException

Specified by:

getRecordWriter in class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<org.apache.hadoop.io.WritableComparable<?>,BytesRefArrayWritable>

Throws:

IOException

InterruptedException