public static class AcidUtils.MetaDataFile extends Object
AcidUtils.AcidBaseFileType.ORIGINAL_BASE
type files
into delta_x_x/ (or base_x in case there is Overwrite clause). AcidUtils.MetaDataFile
is a
small JSON file in this directory that indicates that these files don't have Acid metadata
columns and so the values for these columns need to be assigned at read time/compaction.Constructor and Description |
---|
MetaDataFile() |
Modifier and Type | Method and Description |
---|---|
static void |
createCompactorMarker(org.apache.hadoop.fs.Path baseOrDeltaDir,
org.apache.hadoop.fs.FileSystem fs) |
static boolean |
isRawFormat(org.apache.hadoop.fs.Path baseOrDeltaDir,
org.apache.hadoop.fs.FileSystem fs)
Checks if the files in base/delta dir are a result of Load Data statement and thus do not
have ROW_IDs embedded in the data.
|
static boolean |
isRawFormatFile(org.apache.hadoop.fs.Path dataFile,
org.apache.hadoop.fs.FileSystem fs) |
public static void createCompactorMarker(org.apache.hadoop.fs.Path baseOrDeltaDir, org.apache.hadoop.fs.FileSystem fs) throws IOException
baseOrDeltaDir
- detla or base dir, must existIOException
public static boolean isRawFormat(org.apache.hadoop.fs.Path baseOrDeltaDir, org.apache.hadoop.fs.FileSystem fs) throws IOException
baseOrDeltaDir
- base or delta file.IOException
public static boolean isRawFormatFile(org.apache.hadoop.fs.Path dataFile, org.apache.hadoop.fs.FileSystem fs) throws IOException
IOException
Copyright © 2022 The Apache Software Foundation. All rights reserved.