org.apache.hadoop.hive.ql.io

Class AcidOutputFormat.Options

java.lang.Object

org.apache.hadoop.hive.ql.io.AcidOutputFormat.Options

Direct Known Subclasses:

OrcRecordUpdater.OrcOptions

Enclosing interface:

AcidOutputFormat<K extends org.apache.hadoop.io.WritableComparable,V>

public static class AcidOutputFormat.Options
extends Object

Options to control how the files are written

Constructor Summary

Constructors

Constructor and Description
AcidOutputFormat.Options(org.apache.hadoop.conf.Configuration conf) Create the options object.

Method Summary

Methods

Modifier and Type	Method and Description
AcidOutputFormat.Options	bucket(int bucket) The bucket that is included in this file.
AcidOutputFormat.Options	filesystem(org.apache.hadoop.fs.FileSystem fs) Provide a file system to the writer.
int	getBucket()
org.apache.hadoop.conf.Configuration	getConfiguration()
PrintStream	getDummyStream()
org.apache.hadoop.fs.FileSystem	getFilesystem()
ObjectInspector	getInspector()
long	getMaximumTransactionId()
long	getMinimumTransactionId()
int	getRecordIdColumn()
org.apache.hadoop.mapred.Reporter	getReporter()
Properties	getTableProperties()
AcidOutputFormat.Options	inspector(ObjectInspector inspector) Use the given ObjectInspector for each record written.
boolean	isCompressed()
AcidOutputFormat.Options	isCompressed(boolean isCompressed) Should the output be compressed?
boolean	isWritingBase()
AcidOutputFormat.Options	maximumTransactionId(long max) The maximum transaction id that is included in this file.
AcidOutputFormat.Options	minimumTransactionId(long min) The minimum transaction id that is included in this file.
AcidOutputFormat.Options	recordIdColumn(int recIdCol) Which column the row id field is in.
AcidOutputFormat.Options	reporter(org.apache.hadoop.mapred.Reporter reporter) Provide the MapReduce reporter.
AcidOutputFormat.Options	tableProperties(Properties properties) Provide the table properties for the table.
AcidOutputFormat.Options	useDummy(PrintStream stream) Temporary switch while we are in development that replaces the implementation with a dummy one that just prints to stream.
AcidOutputFormat.Options	writingBase(boolean val) Is this writing a base directory? Should only be used by the compactor, or when implementing insert overwrite.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AcidOutputFormat.Options

public AcidOutputFormat.Options(org.apache.hadoop.conf.Configuration conf)

Create the options object.

Parameters:

conf - Use the given configuration

Method Detail

inspector

public AcidOutputFormat.Options inspector(ObjectInspector inspector)

Use the given ObjectInspector for each record written.

Parameters:

inspector - the inspector to use.

Returns:

this

writingBase

public AcidOutputFormat.Options writingBase(boolean val)

Is this writing a base directory? Should only be used by the compactor, or when implementing insert overwrite.

Parameters:

val - is this a base file?

Returns:

this

filesystem

public AcidOutputFormat.Options filesystem(org.apache.hadoop.fs.FileSystem fs)

Provide a file system to the writer. Otherwise, the filesystem for the path will be used.

Parameters:

fs - the file system that corresponds to the the path

Returns:

this

isCompressed

public AcidOutputFormat.Options isCompressed(boolean isCompressed)

Should the output be compressed?

Parameters:

isCompressed - is the output compressed?

Returns:

this

tableProperties

public AcidOutputFormat.Options tableProperties(Properties properties)

Provide the table properties for the table.

Parameters:

properties - the table's properties

Returns:

this

reporter

public AcidOutputFormat.Options reporter(org.apache.hadoop.mapred.Reporter reporter)

Provide the MapReduce reporter.

Parameters:

reporter - the reporter object

Returns:

this

minimumTransactionId

public AcidOutputFormat.Options minimumTransactionId(long min)

The minimum transaction id that is included in this file.

Parameters:

min - minimum transaction id

Returns:

this

maximumTransactionId

public AcidOutputFormat.Options maximumTransactionId(long max)

The maximum transaction id that is included in this file.

Parameters:

max - maximum transaction id

Returns:

this

bucket

public AcidOutputFormat.Options bucket(int bucket)

The bucket that is included in this file.

Parameters:

bucket - the bucket number

Returns:

this

recordIdColumn

public AcidOutputFormat.Options recordIdColumn(int recIdCol)

Which column the row id field is in.

Parameters:

recIdCol -

Returns:

this

useDummy

public AcidOutputFormat.Options useDummy(PrintStream stream)

Temporary switch while we are in development that replaces the implementation with a dummy one that just prints to stream.

Parameters:

stream - the stream to print to

Returns:

this

getConfiguration

public org.apache.hadoop.conf.Configuration getConfiguration()

getFilesystem

public org.apache.hadoop.fs.FileSystem getFilesystem()

getInspector

public ObjectInspector getInspector()

isCompressed

public boolean isCompressed()

getTableProperties

public Properties getTableProperties()

getReporter

public org.apache.hadoop.mapred.Reporter getReporter()

getMinimumTransactionId

public long getMinimumTransactionId()

getMaximumTransactionId

public long getMaximumTransactionId()

isWritingBase

public boolean isWritingBase()

getBucket

public int getBucket()

getRecordIdColumn

public int getRecordIdColumn()

getDummyStream

public PrintStream getDummyStream()