org.apache.hadoop.hive.ql.io

Class HivePassThroughOutputFormat<K,V>

java.lang.Object

org.apache.hadoop.hive.ql.io.HivePassThroughOutputFormat<K,V>

All Implemented Interfaces:

HiveOutputFormat<K,V>, org.apache.hadoop.mapred.OutputFormat<K,V>

public class HivePassThroughOutputFormat<K,V>
extends Object
implements HiveOutputFormat<K,V>

This pass through class is used to wrap OutputFormat implementations such that new OutputFormats not derived from HiveOutputFormat gets through the checker

Constructor Summary

Constructors

Constructor and Description
HivePassThroughOutputFormat(org.apache.hadoop.mapred.OutputFormat<?,?> outputFormat)

Method Summary

Methods

Modifier and Type	Method and Description
void	checkOutputSpecs(org.apache.hadoop.fs.FileSystem ignored, org.apache.hadoop.mapred.JobConf job)
FileSinkOperator.RecordWriter	getHiveRecordWriter(org.apache.hadoop.mapred.JobConf jc, org.apache.hadoop.fs.Path finalOutPath, Class<? extends org.apache.hadoop.io.Writable> valueClass, boolean isCompressed, Properties tableProperties, org.apache.hadoop.util.Progressable progress) create the final out file and get some specific settings.
org.apache.hadoop.mapred.RecordWriter<K,V>	getRecordWriter(org.apache.hadoop.fs.FileSystem ignored, org.apache.hadoop.mapred.JobConf job, String name, org.apache.hadoop.util.Progressable progress)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HivePassThroughOutputFormat

public HivePassThroughOutputFormat(org.apache.hadoop.mapred.OutputFormat<?,?> outputFormat)

Method Detail

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.fs.FileSystem ignored,
                    org.apache.hadoop.mapred.JobConf job)
                      throws IOException

Specified by:

checkOutputSpecs in interface org.apache.hadoop.mapred.OutputFormat<K,V>

Throws:

IOException

getRecordWriter

public org.apache.hadoop.mapred.RecordWriter<K,V> getRecordWriter(org.apache.hadoop.fs.FileSystem ignored,
                                                         org.apache.hadoop.mapred.JobConf job,
                                                         String name,
                                                         org.apache.hadoop.util.Progressable progress)
                                                           throws IOException

Specified by:

getRecordWriter in interface org.apache.hadoop.mapred.OutputFormat<K,V>

Throws:

IOException

getHiveRecordWriter

public FileSinkOperator.RecordWriter getHiveRecordWriter(org.apache.hadoop.mapred.JobConf jc,
                                                org.apache.hadoop.fs.Path finalOutPath,
                                                Class<? extends org.apache.hadoop.io.Writable> valueClass,
                                                boolean isCompressed,
                                                Properties tableProperties,
                                                org.apache.hadoop.util.Progressable progress)
                                                  throws IOException

Description copied from interface: HiveOutputFormat

create the final out file and get some specific settings.

Specified by:

getHiveRecordWriter in interface HiveOutputFormat<K,V>

Parameters:

jc - the job configuration file

finalOutPath - the final output file to be created

valueClass - the value class used for create

isCompressed - whether the content is compressed or not

tableProperties - the table properties of this file's corresponding table

progress - progress used for status report

Returns:

the RecordWriter for the output file

Throws:

IOException