org.apache.hadoop.hive.ql.io

Class AcidOutputFormat.Options

java.lang.Object

org.apache.hadoop.hive.ql.io.AcidOutputFormat.Options

All Implemented Interfaces:

Cloneable

Direct Known Subclasses:

OrcRecordUpdater.OrcOptions

Enclosing interface:

AcidOutputFormat<K extends org.apache.hadoop.io.WritableComparable,V>

public static class AcidOutputFormat.Options
extends Object
implements Cloneable

Options to control how the files are written

Constructor Summary

Constructors

Constructor and Description
Options(org.apache.hadoop.conf.Configuration conf) Create the options object.

Method Summary

Modifier and Type	Method and Description
AcidOutputFormat.Options	bucket(int bucket) The bucket that is included in this file.
AcidOutputFormat.Options	clone() shallow clone
AcidOutputFormat.Options	filesystem(org.apache.hadoop.fs.FileSystem fs) Provide a file system to the writer.
AcidOutputFormat.Options	finalDestination(org.apache.hadoop.fs.Path p)
int	getBucket()
org.apache.hadoop.conf.Configuration	getConfiguration()
PrintStream	getDummyStream()
org.apache.hadoop.fs.FileSystem	getFilesystem()
org.apache.hadoop.fs.Path	getFinalDestination()
ObjectInspector	getInspector()
long	getMaximumTransactionId()
long	getMinimumTransactionId()
int	getRecordIdColumn()
org.apache.hadoop.mapred.Reporter	getReporter()
int	getStatementId()
Properties	getTableProperties()
AcidOutputFormat.Options	inspector(ObjectInspector inspector) Use the given ObjectInspector for each record written.
boolean	isCompressed()
AcidOutputFormat.Options	isCompressed(boolean isCompressed) Should the output be compressed?
boolean	isWritingBase()
AcidOutputFormat.Options	maximumTransactionId(long max) The maximum transaction id that is included in this file.
AcidOutputFormat.Options	minimumTransactionId(long min) The minimum transaction id that is included in this file.
AcidOutputFormat.Options	recordIdColumn(int recIdCol) Which column the row id field is in.
AcidOutputFormat.Options	reporter(org.apache.hadoop.mapred.Reporter reporter) Provide the MapReduce reporter.
AcidOutputFormat.Options	statementId(int id)
AcidOutputFormat.Options	tableProperties(Properties properties) Provide the table properties for the table.
AcidOutputFormat.Options	useDummy(PrintStream stream) Temporary switch while we are in development that replaces the implementation with a dummy one that just prints to stream.
AcidOutputFormat.Options	writingBase(boolean val) Is this writing a base directory? Should only be used by the compactor, or when implementing insert overwrite.

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Options

public Options(org.apache.hadoop.conf.Configuration conf)

Create the options object.

Parameters:

conf - Use the given configuration

Method Detail

clone

public AcidOutputFormat.Options clone()

shallow clone

Overrides:

clone in class Object

inspector

public AcidOutputFormat.Options inspector(ObjectInspector inspector)

Use the given ObjectInspector for each record written.

Parameters:

inspector - the inspector to use.

Returns:

this

writingBase

public AcidOutputFormat.Options writingBase(boolean val)

Is this writing a base directory? Should only be used by the compactor, or when implementing insert overwrite.

Parameters:

val - is this a base file?

Returns:

this

filesystem

public AcidOutputFormat.Options filesystem(org.apache.hadoop.fs.FileSystem fs)

Provide a file system to the writer. Otherwise, the filesystem for the path will be used.

Parameters:

fs - the file system that corresponds to the the path

Returns:

this

isCompressed

public AcidOutputFormat.Options isCompressed(boolean isCompressed)

Should the output be compressed?

Parameters:

isCompressed - is the output compressed?

Returns:

this

tableProperties

public AcidOutputFormat.Options tableProperties(Properties properties)

Provide the table properties for the table.

Parameters:

properties - the table's properties

Returns:

this

reporter

public AcidOutputFormat.Options reporter(org.apache.hadoop.mapred.Reporter reporter)

Provide the MapReduce reporter.

Parameters:

reporter - the reporter object

Returns:

this

minimumTransactionId

public AcidOutputFormat.Options minimumTransactionId(long min)

The minimum transaction id that is included in this file.

Parameters:

min - minimum transaction id

Returns:

this

maximumTransactionId

public AcidOutputFormat.Options maximumTransactionId(long max)

The maximum transaction id that is included in this file.

Parameters:

max - maximum transaction id

Returns:

this

bucket

public AcidOutputFormat.Options bucket(int bucket)

The bucket that is included in this file.

Parameters:

bucket - the bucket number

Returns:

this

recordIdColumn

public AcidOutputFormat.Options recordIdColumn(int recIdCol)

Which column the row id field is in.

Parameters:

recIdCol -

Returns:

this

useDummy

public AcidOutputFormat.Options useDummy(PrintStream stream)

Temporary switch while we are in development that replaces the implementation with a dummy one that just prints to stream.

Parameters:

stream - the stream to print to

Returns:

this

statementId

public AcidOutputFormat.Options statementId(int id)

Since:

1.3.0 This can be set to -1 to make the system generate old style (delta_xxxx_yyyy) file names. This is primarily needed for testing to make sure 1.3 code can still read files created by older code. Also used by Comactor.

finalDestination

public AcidOutputFormat.Options finalDestination(org.apache.hadoop.fs.Path p)

Parameters:

p - where the data for this operation will eventually end up; basically table or partition directory in FS

getConfiguration

public org.apache.hadoop.conf.Configuration getConfiguration()

getFilesystem

public org.apache.hadoop.fs.FileSystem getFilesystem()

getInspector

public ObjectInspector getInspector()

isCompressed

public boolean isCompressed()

getTableProperties

public Properties getTableProperties()

getReporter

public org.apache.hadoop.mapred.Reporter getReporter()

getMinimumTransactionId

public long getMinimumTransactionId()

getMaximumTransactionId

public long getMaximumTransactionId()

isWritingBase

public boolean isWritingBase()

getBucket

public int getBucket()

getRecordIdColumn

public int getRecordIdColumn()

getDummyStream

public PrintStream getDummyStream()

getStatementId

public int getStatementId()

getFinalDestination

public org.apache.hadoop.fs.Path getFinalDestination()