Package | Description |
---|---|
org.apache.hadoop.hive.ql.exec.vector | |
org.apache.hadoop.hive.ql.optimizer | |
org.apache.hadoop.hive.ql.parse | |
org.apache.hadoop.hive.ql.parse.spark |
Modifier and Type | Class and Description |
---|---|
class |
VectorFileSinkOperator
File Sink operator implementation.
|
Modifier and Type | Method and Description |
---|---|
List<FileSinkOperator> |
GenMRProcContext.getSeenFileSinkOps() |
Modifier and Type | Method and Description |
---|---|
static void |
GenMapRedUtils.addStatsTask(FileSinkOperator nd,
MoveTask mvTask,
Task<? extends Serializable> currTask,
HiveConf hconf)
Add the StatsTask as a dependent task of the MoveTask
because StatsTask will change the Table/Partition metadata.
|
static org.apache.hadoop.fs.Path |
GenMapRedUtils.createMoveTask(Task<? extends Serializable> currTask,
boolean chDir,
FileSinkOperator fsOp,
ParseContext parseCtx,
List<Task<MoveWork>> mvTasks,
HiveConf hconf,
DependencyCollectionTask dependencyTask)
Create and add any dependent move tasks
|
static void |
GenMapRedUtils.createMRWorkForMergingFiles(FileSinkOperator fsInput,
org.apache.hadoop.fs.Path finalName,
DependencyCollectionTask dependencyTask,
List<Task<MoveWork>> mvTasks,
HiveConf conf,
Task<? extends Serializable> currTask,
LineageState lineageState) |
static boolean |
GenMapRedUtils.isInsertInto(ParseContext parseCtx,
FileSinkOperator fsOp)
Returns true iff current query is an insert into for the given file sink
|
static boolean |
GenMapRedUtils.isMergeRequired(List<Task<MoveWork>> mvTasks,
HiveConf hconf,
FileSinkOperator fsOp,
Task<? extends Serializable> currTask,
boolean isInsertTable)
Returns true iff the fsOp requires a merge
|
Modifier and Type | Method and Description |
---|---|
void |
GenMRProcContext.setSeenFileSinkOps(List<FileSinkOperator> seenFileSinkOps) |
Modifier and Type | Field and Description |
---|---|
Set<FileSinkOperator> |
GenTezProcContext.fileSinkSet |
Modifier and Type | Method and Description |
---|---|
static void |
GenTezUtils.processFileSink(GenTezProcContext context,
FileSinkOperator fileSink) |
Modifier and Type | Field and Description |
---|---|
Map<FileSinkOperator,List<FileSinkOperator>> |
GenSparkProcContext.fileSinkMap |
Map<FileSinkOperator,List<FileSinkOperator>> |
GenSparkProcContext.fileSinkMap |
Set<FileSinkOperator> |
GenSparkProcContext.fileSinkSet |
Modifier and Type | Method and Description |
---|---|
static org.apache.hadoop.fs.Path |
GenSparkUtils.createMoveTask(Task<? extends Serializable> currTask,
boolean chDir,
FileSinkOperator fsOp,
ParseContext parseCtx,
List<Task<MoveWork>> mvTasks,
HiveConf hconf,
DependencyCollectionTask dependencyTask)
Create and add any dependent move tasks.
|
void |
GenSparkUtils.processFileSink(GenSparkProcContext context,
FileSinkOperator fileSink) |
Copyright © 2022 The Apache Software Foundation. All rights reserved.