Constructor and Description |
---|
Options(org.apache.hadoop.conf.Configuration conf)
Create the options object.
|
Modifier and Type | Method and Description |
---|---|
AcidOutputFormat.Options |
bucket(int bucket)
The bucketId that is included in this file.
|
AcidOutputFormat.Options |
clone()
shallow clone
|
AcidOutputFormat.Options |
copyNumber(int copyNumber)
Multiple inserts into legacy (pre-acid) tables can generate multiple copies of each bucket
file.
|
AcidOutputFormat.Options |
filesystem(org.apache.hadoop.fs.FileSystem fs)
Provide a file system to the writer.
|
AcidOutputFormat.Options |
finalDestination(org.apache.hadoop.fs.Path p) |
int |
getBucketId() |
org.apache.hadoop.conf.Configuration |
getConfiguration() |
int |
getCopyNumber() |
PrintStream |
getDummyStream() |
org.apache.hadoop.fs.FileSystem |
getFilesystem() |
org.apache.hadoop.fs.Path |
getFinalDestination() |
ObjectInspector |
getInspector() |
long |
getMaximumWriteId() |
long |
getMinimumWriteId() |
int |
getRecordIdColumn() |
org.apache.hadoop.mapred.Reporter |
getReporter() |
int |
getStatementId() |
Properties |
getTableProperties() |
AcidOutputFormat.Options |
inspector(ObjectInspector inspector)
Use the given ObjectInspector for each record written.
|
boolean |
isCompressed() |
AcidOutputFormat.Options |
isCompressed(boolean isCompressed)
Should the output be compressed?
|
boolean |
isWritingBase() |
boolean |
isWritingDeleteDelta() |
AcidOutputFormat.Options |
maximumWriteId(long max)
The maximum write id that is included in this file.
|
AcidOutputFormat.Options |
minimumWriteId(long min)
The minimum write id that is included in this file.
|
AcidOutputFormat.Options |
recordIdColumn(int recIdCol)
Which column the row id field is in.
|
AcidOutputFormat.Options |
reporter(org.apache.hadoop.mapred.Reporter reporter)
Provide the MapReduce reporter.
|
AcidOutputFormat.Options |
statementId(int id) |
AcidOutputFormat.Options |
tableProperties(Properties properties)
Provide the table properties for the table.
|
AcidOutputFormat.Options |
useDummy(PrintStream stream)
Temporary switch while we are in development that replaces the
implementation with a dummy one that just prints to stream.
|
AcidOutputFormat.Options |
writingBase(boolean val)
Is this writing a base directory? Should only be used by the compactor,
or when implementing insert overwrite.
|
AcidOutputFormat.Options |
writingDeleteDelta(boolean val)
Is this writing a delete delta directory?
|
public Options(org.apache.hadoop.conf.Configuration conf)
conf
- Use the given configurationpublic AcidOutputFormat.Options clone()
public AcidOutputFormat.Options inspector(ObjectInspector inspector)
inspector
- the inspector to use.public AcidOutputFormat.Options writingBase(boolean val)
val
- is this a base file?public AcidOutputFormat.Options writingDeleteDelta(boolean val)
val
- is this a delete delta file?public AcidOutputFormat.Options filesystem(org.apache.hadoop.fs.FileSystem fs)
fs
- the file system that corresponds to the the pathpublic AcidOutputFormat.Options isCompressed(boolean isCompressed)
isCompressed
- is the output compressed?public AcidOutputFormat.Options tableProperties(Properties properties)
properties
- the table's propertiespublic AcidOutputFormat.Options reporter(org.apache.hadoop.mapred.Reporter reporter)
reporter
- the reporter objectpublic AcidOutputFormat.Options minimumWriteId(long min)
min
- minimum write idpublic AcidOutputFormat.Options maximumWriteId(long max)
max
- maximum write idpublic AcidOutputFormat.Options bucket(int bucket)
bucket
- the bucketId numberpublic AcidOutputFormat.Options copyNumber(int copyNumber)
copyNumber
- the number of the copy ( > 0)Utilities.COPY_KEYWORD
public AcidOutputFormat.Options recordIdColumn(int recIdCol)
recIdCol
- public AcidOutputFormat.Options useDummy(PrintStream stream)
stream
- the stream to print topublic AcidOutputFormat.Options statementId(int id)
public AcidOutputFormat.Options finalDestination(org.apache.hadoop.fs.Path p)
p
- where the data for this operation will eventually end up;
basically table or partition directory in FSpublic org.apache.hadoop.conf.Configuration getConfiguration()
public org.apache.hadoop.fs.FileSystem getFilesystem()
public ObjectInspector getInspector()
public boolean isCompressed()
public Properties getTableProperties()
public org.apache.hadoop.mapred.Reporter getReporter()
public long getMinimumWriteId()
public long getMaximumWriteId()
public boolean isWritingBase()
public boolean isWritingDeleteDelta()
public int getBucketId()
public int getRecordIdColumn()
public PrintStream getDummyStream()
public int getStatementId()
public int getCopyNumber()
public org.apache.hadoop.fs.Path getFinalDestination()
Copyright © 2022 The Apache Software Foundation. All rights reserved.