org.apache.hadoop.hive.ql.io

Class HiveNullValueSequenceFileOutputFormat<K,V>

java.lang.Object

org.apache.hadoop.mapred.FileOutputFormat<K,V>

org.apache.hadoop.mapred.SequenceFileOutputFormat<K,V>

org.apache.hadoop.hive.ql.io.HiveNullValueSequenceFileOutputFormat<K,V>

All Implemented Interfaces:

HiveOutputFormat<K,V>, org.apache.hadoop.mapred.OutputFormat<K,V>

public class HiveNullValueSequenceFileOutputFormat<K,V>
extends org.apache.hadoop.mapred.SequenceFileOutputFormat<K,V>
implements HiveOutputFormat<K,V>

A HiveOutputFormat that writes SequenceFiles with the content saved in the keys, and null in the values.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileOutputFormat

org.apache.hadoop.mapred.FileOutputFormat.Counter

Constructor Summary

Constructors

Constructor and Description
HiveNullValueSequenceFileOutputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
FileSinkOperator.RecordWriter	getHiveRecordWriter(org.apache.hadoop.mapred.JobConf jc, org.apache.hadoop.fs.Path finalOutPath, Class<? extends org.apache.hadoop.io.Writable> valueClass, boolean isCompressed, Properties tableProperties, org.apache.hadoop.util.Progressable progress) create the final out file and get some specific settings.

Methods inherited from class org.apache.hadoop.mapred.SequenceFileOutputFormat

getOutputCompressionType, getReaders, getRecordWriter, setOutputCompressionType

Methods inherited from class org.apache.hadoop.mapred.FileOutputFormat

checkOutputSpecs, getCompressOutput, getOutputCompressorClass, getOutputPath, getPathForCustomFile, getTaskOutputPath, getUniqueName, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputPath, setWorkOutputPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.mapred.OutputFormat

checkOutputSpecs, getRecordWriter

Constructor Detail

HiveNullValueSequenceFileOutputFormat

public HiveNullValueSequenceFileOutputFormat()

Method Detail

getHiveRecordWriter

public FileSinkOperator.RecordWriter getHiveRecordWriter(org.apache.hadoop.mapred.JobConf jc,
                                                org.apache.hadoop.fs.Path finalOutPath,
                                                Class<? extends org.apache.hadoop.io.Writable> valueClass,
                                                boolean isCompressed,
                                                Properties tableProperties,
                                                org.apache.hadoop.util.Progressable progress)
                                                  throws IOException

Description copied from interface: HiveOutputFormat

create the final out file and get some specific settings.

Specified by:

getHiveRecordWriter in interface HiveOutputFormat<K,V>

Parameters:

jc - the job configuration file

finalOutPath - the final output file to be created

valueClass - the value class used for create

isCompressed - whether the content is compressed or not

tableProperties - the table properties of this file's corresponding table

progress - progress used for status report

Returns:

the RecordWriter for the output file

Throws:

IOException