public class VectorFileSinkOperator extends FileSinkOperator implements VectorizationOperator
FileSinkOperator.Counter, FileSinkOperator.FSPaths, FileSinkOperator.RecordWriter
Operator.OperatorFunc, Operator.State
Modifier and Type | Field and Description |
---|---|
protected Object[] |
singleRow |
autoDelete, bDynParts, bucketMap, cntr, dpColNames, dpCtx, dpStartCol, dpVals, dpWritables, filesCreated, fs, fsp, hiveOutputFormat, isCollectRWStats, isCompressed, isSkewedStoredAsSubDirectories, isTemporary, isUnionDp, jc, key, lbCtx, LOG, logEveryNRows, maxPartitions, multiFileSpray, numDynParts, numRows, parent, prtner, recordValue, row_count, rowIndex, rowOutWriters, serializer, specPath, statsFromRecordWriter, totalFiles, unionPath, valToPaths
abortOp, alias, asyncInitOperations, bucketingVersion, cContext, childOperators, childOperatorsArray, childOperatorsTag, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVE_COUNTER_CREATED_DYNAMIC_PARTITIONS, HIVE_COUNTER_CREATED_FILES, HIVE_COUNTER_FATAL, id, indexForTezUnion, inputObjInspectors, operatorId, out, outputObjInspector, parentOperators, reporter, runTimeNumRows, state, statsMap
Constructor and Description |
---|
VectorFileSinkOperator()
Kryo ctor.
|
VectorFileSinkOperator(CompilationOpContext ctx) |
VectorFileSinkOperator(CompilationOpContext ctx,
OperatorDesc conf,
VectorizationContext vContext,
VectorDesc vectorDesc) |
Modifier and Type | Method and Description |
---|---|
VectorizationContext |
getInputVectorizationContext() |
VectorDesc |
getVectorDesc() |
protected void |
initializeOp(org.apache.hadoop.conf.Configuration hconf)
Operator specific initialization.
|
void |
process(Object data,
int tag)
Process the row.
|
areAllTrue, augmentPlan, checkOutputSpecs, closeOp, createBucketFiles, createBucketForFileIdx, generateListBucketingDirName, getCounterName, getDynOutPaths, getName, getOperatorName, getType, jobCloseOp, updateProgress
abort, acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, cleanUpInputFileChanged, cleanUpInputFileChangedOp, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, completeInitializationOp, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, endGroup, flush, flushRecursive, forward, forward, forward, getAdditionalCounters, getBucketingVersion, getChildOperators, getChildren, getColumnExprMap, getCompilationOpContext, getConf, getConfiguration, getCounterName, getDone, getExecContext, getGroupKeyObject, getIdentifier, getIndexForTezUnion, getInputObjInspectors, getIsReduceSink, getMarker, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getReduceOutputName, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, logicalEquals, logicalEqualsTree, logStats, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeParent, removeParents, replaceChild, replaceParent, reset, setAlias, setBucketingVersion, setChildOperators, setColumnExprMap, setCompilationOpContext, setConf, setDone, setExecContext, setGroupKeyObject, setIndexForTezUnion, setInputContext, setInputObjInspectors, setMarker, setNextVectorBatchGroupStatus, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, startGroup, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString
protected transient Object[] singleRow
public VectorFileSinkOperator(CompilationOpContext ctx, OperatorDesc conf, VectorizationContext vContext, VectorDesc vectorDesc)
public VectorFileSinkOperator()
public VectorFileSinkOperator(CompilationOpContext ctx)
public VectorizationContext getInputVectorizationContext()
getInputVectorizationContext
in interface VectorizationOperator
protected void initializeOp(org.apache.hadoop.conf.Configuration hconf) throws HiveException
Operator
initializeOp
in class FileSinkOperator
HiveException
public void process(Object data, int tag) throws HiveException
Operator
process
in class FileSinkOperator
data
- The object representing the row.tag
- The tag of the row usually means which parent this row comes from.
Rows with the same tag should have exactly the same rowInspector
all the time.HiveException
public VectorDesc getVectorDesc()
getVectorDesc
in interface VectorizationOperator
Copyright © 2022 The Apache Software Foundation. All rights reserved.