Modifier and Type | Method and Description |
---|---|
HiveStoragePredicateHandler.DecomposedPredicate |
AccumuloStorageHandler.decomposePredicate(org.apache.hadoop.mapred.JobConf conf,
Deserializer deserializer,
ExprNodeDesc desc) |
Modifier and Type | Method and Description |
---|---|
ExprNodeDesc |
AccumuloPredicateHandler.getExpression(org.apache.hadoop.conf.Configuration conf) |
Modifier and Type | Method and Description |
---|---|
HiveStoragePredicateHandler.DecomposedPredicate |
AccumuloPredicateHandler.decompose(org.apache.hadoop.conf.Configuration conf,
ExprNodeDesc desc) |
protected Object |
AccumuloPredicateHandler.generateRanges(org.apache.hadoop.conf.Configuration conf,
ColumnMapper columnMapper,
String hiveRowIdColumnName,
ExprNodeDesc root)
Encapsulates the traversal over some
ExprNodeDesc tree for the generation of Accumuluo. |
protected Object |
AccumuloRangeGenerator.getIndexedRowIds(GenericUDF genericUdf,
ExprNodeDesc leftHandNode,
String columnName,
ConstantObjectInspector objInspector) |
Modifier and Type | Method and Description |
---|---|
HiveStoragePredicateHandler.DecomposedPredicate |
AbstractHBaseKeyFactory.decomposePredicate(org.apache.hadoop.mapred.JobConf jobConf,
Deserializer deserializer,
ExprNodeDesc predicate) |
HiveStoragePredicateHandler.DecomposedPredicate |
HBaseStorageHandler.decomposePredicate(org.apache.hadoop.mapred.JobConf jobConf,
Deserializer deserializer,
ExprNodeDesc predicate) |
static HiveStoragePredicateHandler.DecomposedPredicate |
HBaseStorageHandler.decomposePredicate(org.apache.hadoop.mapred.JobConf jobConf,
HBaseSerDe hBaseSerDe,
ExprNodeDesc predicate) |
HiveStoragePredicateHandler.DecomposedPredicate |
AbstractHBaseKeyPredicateDecomposer.decomposePredicate(String keyColName,
ExprNodeDesc predicate) |
Modifier and Type | Class and Description |
---|---|
class |
ExprNodeEvaluator<T extends ExprNodeDesc>
ExprNodeEvaluator.
|
Modifier and Type | Field and Description |
---|---|
protected T |
ExprNodeEvaluator.expr |
Modifier and Type | Method and Description |
---|---|
Map<String,ExprNodeDesc> |
Operator.getColumnExprMap()
Returns a map of output column name to input expression map Note that
currently it returns only key columns for ReduceSink and GroupBy operators.
|
Modifier and Type | Method and Description |
---|---|
static ExprNodeEvaluator |
ExprNodeEvaluatorFactory.get(ExprNodeDesc desc) |
static ExprNodeEvaluator |
ExprNodeEvaluatorFactory.get(ExprNodeDesc desc,
org.apache.hadoop.conf.Configuration conf) |
static boolean |
FunctionRegistry.isIn(ExprNodeDesc desc)
Returns whether the exprNodeDesc is a node of "in".
|
static boolean |
FunctionRegistry.isOpAnd(ExprNodeDesc desc)
Returns whether the exprNodeDesc is a node of "and".
|
static boolean |
FunctionRegistry.isOpAndOrNot(ExprNodeDesc desc)
Returns whether the exprNodeDesc is a node of "and", "or", "not".
|
static boolean |
FunctionRegistry.isOpCast(ExprNodeDesc desc)
Returns whether the exprNodeDesc is node of "cast".
|
static boolean |
FunctionRegistry.isOpNot(ExprNodeDesc desc)
Returns whether the exprNodeDesc is a node of "not".
|
static boolean |
FunctionRegistry.isOpOr(ExprNodeDesc desc)
Returns whether the exprNodeDesc is a node of "or".
|
static boolean |
FunctionRegistry.isOpPositive(ExprNodeDesc desc)
Returns whether the exprNodeDesc is a node of "positive".
|
static boolean |
FunctionRegistry.isOpPreserveInputName(ExprNodeDesc desc)
Returns whether the exprNodeDesc can recommend name for the expression
|
FunctionInfo |
Registry.registerMacro(String macroName,
ExprNodeDesc body,
List<String> colNames,
List<TypeInfo> colTypes) |
FunctionInfo |
Registry.registerMacro(String macroName,
ExprNodeDesc body,
List<String> colNames,
List<TypeInfo> colTypes,
FunctionInfo.FunctionResource... resources) |
static void |
FunctionRegistry.registerTemporaryMacro(String macroName,
ExprNodeDesc body,
List<String> colNames,
List<TypeInfo> colTypes)
Registers the appropriate kind of temporary function based on a class's
type.
|
Modifier and Type | Method and Description |
---|---|
static <T extends OperatorDesc> |
OperatorFactory.getAndMakeChild(CompilationOpContext cContext,
T conf,
RowSchema rwsch,
Map<String,ExprNodeDesc> colExprMap,
List<Operator<? extends OperatorDesc>> oplist)
Returns an operator given the conf and a list of parent operators.
|
static <T extends OperatorDesc> |
OperatorFactory.getAndMakeChild(T conf,
RowSchema rwsch,
Map<String,ExprNodeDesc> colExprMap,
Operator oplist0,
Operator... oplist)
Returns an operator given the conf and a list of parent operators.
|
static int |
JoinUtil.populateJoinKeyValue(List<ExprNodeEvaluator>[] outMap,
Map<Byte,List<ExprNodeDesc>> inputMap,
Byte[] order,
int posBigTableAlias,
org.apache.hadoop.conf.Configuration conf) |
static int |
JoinUtil.populateJoinKeyValue(List<ExprNodeEvaluator>[] outMap,
Map<Byte,List<ExprNodeDesc>> inputMap,
int posBigTableAlias,
org.apache.hadoop.conf.Configuration conf) |
void |
Operator.setColumnExprMap(Map<String,ExprNodeDesc> colExprMap) |
Constructor and Description |
---|
Handler(ObjectInspector inputObjInspector,
List<ExprNodeDesc> keyCols,
List<ExprNodeDesc> valueCols,
List<String> outputKeyColumnNames,
List<String> outputValueColumnNames,
Integer tag) |
Handler(ObjectInspector inputObjInspector,
List<ExprNodeDesc> keyCols,
List<ExprNodeDesc> valueCols,
List<String> outputKeyColumnNames,
List<String> outputValueColumnNames,
Integer tag) |
Modifier and Type | Method and Description |
---|---|
protected org.apache.hadoop.hive.ql.exec.tez.DynamicPartitionPruner.SourceInfo |
DynamicPartitionPruner.createSourceInfo(TableDesc t,
ExprNodeDesc partKeyExpr,
String columnName,
String columnType,
org.apache.hadoop.mapred.JobConf jobConf) |
Modifier and Type | Method and Description |
---|---|
VectorExpression |
VectorizationContext.getVectorExpression(ExprNodeDesc exprDesc) |
VectorExpression |
VectorizationContext.getVectorExpression(ExprNodeDesc exprDesc,
VectorExpressionDescriptor.Mode mode)
Returns a vector expression for a given expression
description.
|
Modifier and Type | Method and Description |
---|---|
VectorExpression[] |
VectorizationContext.getVectorExpressions(List<ExprNodeDesc> exprNodes) |
VectorExpression[] |
VectorizationContext.getVectorExpressions(List<ExprNodeDesc> exprNodes,
VectorExpressionDescriptor.Mode mode) |
VectorExpression[] |
VectorizationContext.getVectorExpressionsUpConvertDecimal64(List<ExprNodeDesc> exprNodes) |
boolean |
VectorizationContext.haveCandidateForDecimal64VectorExpression(int numChildren,
List<ExprNodeDesc> childExpr,
TypeInfo returnType) |
Modifier and Type | Method and Description |
---|---|
static VectorExpressionWriter |
VectorExpressionWriterFactory.genVectorExpressionWritable(ExprNodeDesc nodeDesc)
Compiles the appropriate vector expression writer based on an expression info (ExprNodeDesc)
|
Modifier and Type | Method and Description |
---|---|
static VectorExpressionWriter[] |
VectorExpressionWriterFactory.getExpressionWriters(List<ExprNodeDesc> nodesDesc)
Helper function to create an array of writers from a list of expression descriptors.
|
static void |
VectorExpressionWriterFactory.processVectorExpressions(List<ExprNodeDesc> nodesDesc,
List<String> columnNames,
VectorExpressionWriterFactory.SingleOIDClosure closure)
Creates the value writers for a column vector expression list.
|
static void |
VectorExpressionWriterFactory.processVectorExpressions(List<ExprNodeDesc> nodesDesc,
VectorExpressionWriterFactory.ListOIDClosure closure)
Creates the value writers for a column vector expression list.
|
void |
StructColumnInList.setStructColumnExprs(VectorizationContext vContext,
List<ExprNodeDesc> structColumnExprs,
org.apache.hadoop.hive.ql.exec.vector.ColumnVector.Type[] fieldVectorColumnTypes) |
void |
IStructInExpr.setStructColumnExprs(VectorizationContext vContext,
List<ExprNodeDesc> structColumnExprs,
org.apache.hadoop.hive.ql.exec.vector.ColumnVector.Type[] fieldVectorColumnTypes) |
void |
FilterStructColumnInList.setStructColumnExprs(VectorizationContext vContext,
List<ExprNodeDesc> structColumnExprs,
org.apache.hadoop.hive.ql.exec.vector.ColumnVector.Type[] fieldVectorColumnTypes) |
Modifier and Type | Method and Description |
---|---|
ExprNodeDesc |
IndexPredicateAnalyzer.analyzePredicate(ExprNodeDesc predicate,
List<IndexSearchCondition> searchConditions)
Deprecated.
Analyzes a predicate.
|
Modifier and Type | Method and Description |
---|---|
ExprNodeDesc |
IndexPredicateAnalyzer.analyzePredicate(ExprNodeDesc predicate,
List<IndexSearchCondition> searchConditions)
Deprecated.
Analyzes a predicate.
|
Modifier and Type | Method and Description |
---|---|
HiveStoragePredicateHandler.DecomposedPredicate |
HiveStoragePredicateHandler.decomposePredicate(org.apache.hadoop.mapred.JobConf jobConf,
Deserializer deserializer,
ExprNodeDesc predicate)
Gives the storage handler a chance to decompose a predicate.
|
Modifier and Type | Method and Description |
---|---|
static ExprNodeDesc |
ConstantPropagateProcFactory.foldExpr(ExprNodeGenericFuncDesc funcDesc) |
protected abstract ExprNodeDesc |
PrunerExpressionOperatorFactory.ColumnExprProcessor.processColumnDesc(NodeProcessorCtx procCtx,
ExprNodeColumnDesc cd)
Process column desc.
|
Modifier and Type | Method and Description |
---|---|
Map<Byte,List<ExprNodeDesc>> |
SortBucketJoinProcCtx.getKeyExprMap() |
static ObjectPair<List<ReduceSinkOperator>,Map<Byte,List<ExprNodeDesc>>> |
MapJoinProcessor.getKeys(boolean leftInputJoin,
String[] baseSrc,
JoinOperator op) |
Map<Operator<? extends Serializable>,Map<ColumnInfo,ExprNodeDesc>> |
ConstantPropagateProcCtx.getOpToConstantExprs() |
Map<ColumnInfo,ExprNodeDesc> |
ConstantPropagateProcCtx.getPropagatedConstants(Operator<? extends Serializable> op)
Get propagated constant map from parents.
|
Modifier and Type | Method and Description |
---|---|
protected void |
PrunerOperatorFactory.FilterPruner.addPruningPred(Map<TableScanOperator,ExprNodeDesc> opToPrunner,
TableScanOperator top,
ExprNodeDesc new_pruner_pred)
Add pruning predicate.
|
protected void |
PrunerOperatorFactory.FilterPruner.addPruningPred(Map<TableScanOperator,Map<String,ExprNodeDesc>> opToPrunner,
TableScanOperator top,
ExprNodeDesc new_pruner_pred,
Partition part)
Add pruning predicate.
|
static Map<Node,Object> |
PrunerUtils.walkExprTree(ExprNodeDesc pred,
NodeProcessorCtx ctx,
NodeProcessor colProc,
NodeProcessor fieldProc,
NodeProcessor genFuncProc,
NodeProcessor defProc)
Walk expression tree for pruner generation.
|
Modifier and Type | Method and Description |
---|---|
protected void |
PrunerOperatorFactory.FilterPruner.addPruningPred(Map<TableScanOperator,ExprNodeDesc> opToPrunner,
TableScanOperator top,
ExprNodeDesc new_pruner_pred)
Add pruning predicate.
|
protected void |
PrunerOperatorFactory.FilterPruner.addPruningPred(Map<TableScanOperator,Map<String,ExprNodeDesc>> opToPrunner,
TableScanOperator top,
ExprNodeDesc new_pruner_pred,
Partition part)
Add pruning predicate.
|
protected boolean |
AbstractBucketJoinProc.checkConvertBucketMapJoin(BucketJoinProcCtx context,
Map<String,Operator<? extends OperatorDesc>> aliasToOpInfo,
Map<Byte,List<ExprNodeDesc>> keysMap,
String baseBigAlias,
List<String> joinAliases) |
void |
SortBucketJoinProcCtx.setKeyExprMap(Map<Byte,List<ExprNodeDesc>> keyExprMap) |
static List<String> |
AbstractBucketJoinProc.toColumns(List<ExprNodeDesc> keys) |
Modifier and Type | Method and Description |
---|---|
static ExprNodeDesc |
HiveCalciteUtil.getExprNode(Integer inputRefIndx,
org.apache.calcite.rel.RelNode inputRel,
ExprNodeConverter exprConv) |
Modifier and Type | Method and Description |
---|---|
static List<ExprNodeDesc> |
HiveCalciteUtil.getExprNodes(List<Integer> inputRefs,
org.apache.calcite.rel.RelNode inputRel,
String inputTabAlias) |
Modifier and Type | Method and Description |
---|---|
ExprNodeDesc[] |
HiveSortExchange.getJoinExpressions() |
Modifier and Type | Method and Description |
---|---|
void |
HiveSortExchange.setJoinExpressions(ExprNodeDesc[] joinExpressions) |
Modifier and Type | Method and Description |
---|---|
ExprNodeDesc |
ExprNodeConverter.visitCall(org.apache.calcite.rex.RexCall call) |
ExprNodeDesc |
ExprNodeConverter.visitFieldAccess(org.apache.calcite.rex.RexFieldAccess fieldAccess)
TODO: Handle 1) cast 2), Windowing Agg Call
|
ExprNodeDesc |
ExprNodeConverter.visitInputRef(org.apache.calcite.rex.RexInputRef inputRef) |
ExprNodeDesc |
ExprNodeConverter.visitLiteral(org.apache.calcite.rex.RexLiteral literal) |
ExprNodeDesc |
ExprNodeConverter.visitOver(org.apache.calcite.rex.RexOver over) |
Modifier and Type | Method and Description |
---|---|
static Map<ASTNode,ExprNodeDesc> |
JoinCondTypeCheckProcFactory.genExprNode(ASTNode expr,
TypeCheckCtx tcCtx) |
Modifier and Type | Method and Description |
---|---|
org.apache.calcite.rex.RexNode |
RexNodeConverter.convert(ExprNodeDesc expr) |
static org.apache.calcite.rex.RexNode |
RexNodeConverter.convert(org.apache.calcite.plan.RelOptCluster cluster,
ExprNodeDesc joinCondnExprNode,
List<org.apache.calcite.rel.RelNode> inputRels,
LinkedHashMap<org.apache.calcite.rel.RelNode,RowResolver> relToHiveRR,
Map<org.apache.calcite.rel.RelNode,com.google.common.collect.ImmutableMap<String,Integer>> relToHiveColNameCalcitePosMap,
boolean flattenExpr) |
Modifier and Type | Method and Description |
---|---|
protected static String |
CorrelationUtilities.getColumnName(Map<String,ExprNodeDesc> opColumnExprMap,
ExprNodeDesc expr) |
protected static int |
CorrelationUtilities.indexOf(ExprNodeDesc cexpr,
ExprNodeDesc[] pexprs,
Operator child,
Operator[] parents,
boolean[] sorted) |
protected static int |
CorrelationUtilities.indexOf(ExprNodeDesc cexpr,
ExprNodeDesc[] pexprs,
Operator child,
Operator[] parents,
boolean[] sorted) |
protected static boolean |
CorrelationUtilities.isExisted(ExprNodeDesc expr,
List<ExprNodeDesc> columns) |
Modifier and Type | Method and Description |
---|---|
protected static String |
CorrelationUtilities.getColumnName(Map<String,ExprNodeDesc> opColumnExprMap,
ExprNodeDesc expr) |
protected static boolean |
CorrelationUtilities.isExisted(ExprNodeDesc expr,
List<ExprNodeDesc> columns) |
protected static Integer |
ReduceSinkDeDuplicationUtils.sameKeys(List<ExprNodeDesc> cexprs,
List<ExprNodeDesc> pexprs,
Operator<?> child,
Operator<?> parent) |
protected static Integer |
ReduceSinkDeDuplicationUtils.sameKeys(List<ExprNodeDesc> cexprs,
List<ExprNodeDesc> pexprs,
Operator<?> child,
Operator<?> parent) |
Modifier and Type | Method and Description |
---|---|
static LineageInfo.Dependency |
ExprProcFactory.getExprDependency(LineageCtx lctx,
Operator<? extends OperatorDesc> inpOp,
ExprNodeDesc expr)
Gets the expression dependencies for the expression.
|
static LineageInfo.Dependency |
ExprProcFactory.getExprDependency(LineageCtx lctx,
Operator<? extends OperatorDesc> inpOp,
ExprNodeDesc expr,
HashMap<Node,Object> outputMap)
Gets the expression dependencies for the expression.
|
static String |
ExprProcFactory.getExprString(RowSchema rs,
ExprNodeDesc expr,
LineageCtx lctx,
Operator<? extends OperatorDesc> inpOp,
LineageInfo.Predicate cond)
Get the expression string of an expression node.
|
Modifier and Type | Method and Description |
---|---|
static ExprNodeDesc |
LBExprProcFactory.genPruner(String tabAlias,
ExprNodeDesc pred,
Partition part)
Generates the list bucketing pruner for the expression tree.
|
protected ExprNodeDesc |
LBExprProcFactory.LBPRColumnExprProcessor.processColumnDesc(NodeProcessorCtx procCtx,
ExprNodeColumnDesc cd) |
Modifier and Type | Method and Description |
---|---|
Map<TableScanOperator,Map<String,ExprNodeDesc>> |
LBOpWalkerCtx.getOpToPartToLBPruner() |
Modifier and Type | Method and Description |
---|---|
static ExprNodeDesc |
LBExprProcFactory.genPruner(String tabAlias,
ExprNodeDesc pred,
Partition part)
Generates the list bucketing pruner for the expression tree.
|
static org.apache.hadoop.fs.Path[] |
ListBucketingPruner.prune(ParseContext ctx,
Partition part,
ExprNodeDesc pruner)
Prunes to the directories which match the skewed keys in where clause.
|
Constructor and Description |
---|
LBOpWalkerCtx(Map<TableScanOperator,Map<String,ExprNodeDesc>> opToPartToLBPruner,
Partition part)
Constructor.
|
Modifier and Type | Field and Description |
---|---|
ExprNodeDesc |
PcrExprProcFactory.NodeInfoWrapper.outExpr |
Modifier and Type | Method and Description |
---|---|
static PcrExprProcFactory.NodeInfoWrapper |
PcrExprProcFactory.walkExprTree(String tabAlias,
ArrayList<Partition> parts,
List<VirtualColumn> vcs,
ExprNodeDesc pred)
Remove partition conditions when necessary from the the expression tree.
|
Constructor and Description |
---|
NodeInfoWrapper(PcrExprProcFactory.WalkState state,
Boolean[] resultVector,
ExprNodeDesc outExpr) |
Modifier and Type | Method and Description |
---|---|
static ExprNodeDesc |
ExprProcFactory.genPruner(String tabAlias,
ExprNodeDesc pred)
Generates the partition pruner for the expression tree.
|
protected ExprNodeDesc |
ExprProcFactory.PPRColumnExprProcessor.processColumnDesc(NodeProcessorCtx procCtx,
ExprNodeColumnDesc cd) |
Modifier and Type | Method and Description |
---|---|
HashMap<TableScanOperator,ExprNodeDesc> |
OpWalkerCtx.getOpToPartPruner() |
Modifier and Type | Method and Description |
---|---|
static Object |
PartExprEvalUtils.evalExprWithPart(ExprNodeDesc expr,
Partition p,
List<VirtualColumn> vcs,
StructObjectInspector rowObjectInspector)
Evaluate expression with partition columns
|
static ExprNodeDesc |
ExprProcFactory.genPruner(String tabAlias,
ExprNodeDesc pred)
Generates the partition pruner for the expression tree.
|
static boolean |
PartitionPruner.hasColumnExpr(ExprNodeDesc desc)
Whether the expression contains a column node or not.
|
static boolean |
PartitionPruner.onlyContainsPartnCols(Table tab,
ExprNodeDesc expr)
Find out whether the condition only contains partitioned columns.
|
static PrunedPartitionList |
PartitionPruner.prune(Table tab,
ExprNodeDesc prunerExpr,
HiveConf conf,
String alias,
Map<String,PrunedPartitionList> prunedPartitionsMap)
Get the partition list for the table that satisfies the partition pruner
condition.
|
Constructor and Description |
---|
OpWalkerCtx(HashMap<TableScanOperator,ExprNodeDesc> opToPartPruner)
Constructor.
|
Modifier and Type | Field and Description |
---|---|
ExprNodeDesc |
SparkPartitionPruningSinkDesc.DPPTargetInfo.partKey |
Modifier and Type | Method and Description |
---|---|
void |
SparkPartitionPruningSinkDesc.addTarget(String colName,
String colType,
ExprNodeDesc partKey,
MapWork mapWork,
TableScanOperator tableScan) |
Modifier and Type | Method and Description |
---|---|
protected long |
StatsRulesProcFactory.FilterStatsRule.evaluateExpression(Statistics stats,
ExprNodeDesc pred,
AnnotateStatsProcCtx aspCtx,
List<String> neededCols,
Operator<?> op,
long currNumRows) |
Modifier and Type | Field and Description |
---|---|
ExprNodeDesc |
GenTezUtils.DynamicListContext.grandParent |
ExprNodeDesc |
GenTezUtils.DynamicListContext.parent |
Modifier and Type | Field and Description |
---|---|
ArrayList<ExprNodeDesc> |
SemanticAnalyzer.GenericUDAFInfo.convertedParameters |
Modifier and Type | Method and Description |
---|---|
static ExprNodeDesc |
ParseUtils.createConversionCast(ExprNodeDesc column,
PrimitiveTypeInfo tableFieldTypeInfo) |
ExprNodeDesc |
SemanticAnalyzer.genExprNodeDesc(ASTNode expr,
RowResolver input)
Generates an expression node descriptor for the expression with TypeCheckCtx.
|
ExprNodeDesc |
SemanticAnalyzer.genExprNodeDesc(ASTNode expr,
RowResolver input,
boolean useCaching) |
ExprNodeDesc |
SemanticAnalyzer.genExprNodeDesc(ASTNode expr,
RowResolver input,
boolean useCaching,
boolean foldExpr) |
ExprNodeDesc |
SemanticAnalyzer.genExprNodeDesc(ASTNode expr,
RowResolver input,
RowResolver outerRR,
Map<ASTNode,org.apache.calcite.rel.RelNode> subqueryToRelNode,
boolean useCaching) |
ExprNodeDesc |
SemanticAnalyzer.genExprNodeDesc(ASTNode expr,
RowResolver input,
TypeCheckCtx tcCtx)
Returns expression node descriptor for the expression.
|
static ExprNodeDesc |
TypeCheckProcFactory.DefaultExprProcessor.getFuncExprNodeDesc(String udfName,
ExprNodeDesc... children) |
ExprNodeDesc |
RuntimeValuesInfo.getTsColExpr() |
protected ExprNodeDesc |
TypeCheckProcFactory.DefaultExprProcessor.getXpathOrFuncExprNodeDesc(ASTNode expr,
boolean isFunction,
ArrayList<ExprNodeDesc> children,
TypeCheckCtx ctx) |
static ExprNodeDesc |
SemanticAnalyzer.isConstantParameterInAggregationParameters(String internalName,
List<ExprNodeDesc> reduceValues)
Check if the given internalName represents a constant parameter in aggregation parameters
of an aggregation tree.
|
static ExprNodeDesc |
TypeCheckProcFactory.processGByExpr(Node nd,
Object procCtx)
Function to do groupby subexpression elimination.
|
protected ExprNodeDesc |
TypeCheckProcFactory.DefaultExprProcessor.processQualifiedColRef(TypeCheckCtx ctx,
ASTNode expr,
Object... nodeOutputs) |
Modifier and Type | Method and Description |
---|---|
protected List<ExprNodeDesc> |
SemanticAnalyzer.determineSprayKeys(QBParseInfo qbp,
String dest,
RowResolver inputRR) |
Map<ASTNode,ExprNodeDesc> |
SemanticAnalyzer.genAllExprNodeDesc(ASTNode expr,
RowResolver input)
Generates an expression node descriptors for the expression and children of it
with default TypeCheckCtx.
|
Map<ASTNode,ExprNodeDesc> |
SemanticAnalyzer.genAllExprNodeDesc(ASTNode expr,
RowResolver input,
TypeCheckCtx tcCtx)
Generates all of the expression node descriptors for the expression and children of it
passed in the arguments.
|
static Map<ASTNode,ExprNodeDesc> |
TypeCheckProcFactory.genExprNode(ASTNode expr,
TypeCheckCtx tcCtx) |
protected static Map<ASTNode,ExprNodeDesc> |
TypeCheckProcFactory.genExprNode(ASTNode expr,
TypeCheckCtx tcCtx,
TypeCheckProcFactory tf) |
List<ExprNodeDesc> |
RuntimeValuesInfo.getColExprs() |
Map<ExprNodeDesc,GroupByOperator> |
ParseContext.getColExprToGBMap() |
HashMap<TableScanOperator,ExprNodeDesc> |
ParseContext.getOpToPartPruner() |
Map<TableScanOperator,Map<String,ExprNodeDesc>> |
ParseContext.getOpToPartToSkewedPruner() |
Modifier and Type | Method and Description |
---|---|
static GenericUDAFEvaluator |
SemanticAnalyzer.getGenericUDAFEvaluator(String aggName,
ArrayList<ExprNodeDesc> aggParameters,
ASTNode aggTree,
boolean isDistinct,
boolean isAllColumns)
Returns the GenericUDAFEvaluator for the aggregation.
|
static SemanticAnalyzer.GenericUDAFInfo |
SemanticAnalyzer.getGenericUDAFInfo(GenericUDAFEvaluator evaluator,
GenericUDAFEvaluator.Mode emode,
ArrayList<ExprNodeDesc> aggParameters)
Returns the GenericUDAFInfo struct for the aggregation.
|
protected ExprNodeDesc |
TypeCheckProcFactory.DefaultExprProcessor.getXpathOrFuncExprNodeDesc(ASTNode expr,
boolean isFunction,
ArrayList<ExprNodeDesc> children,
TypeCheckCtx ctx) |
RowResolver |
SemanticAnalyzer.handleInsertStatementSpec(List<ExprNodeDesc> col_list,
String dest,
RowResolver outputRR,
RowResolver inputRR,
QB qb,
ASTNode selExprList)
This modifies the Select projections when the Select is part of an insert statement and
the insert statement specifies a column list for the target table, e.g.
|
static ExprNodeDesc |
SemanticAnalyzer.isConstantParameterInAggregationParameters(String internalName,
List<ExprNodeDesc> reduceValues)
Check if the given internalName represents a constant parameter in aggregation parameters
of an aggregation tree.
|
protected static boolean |
TypeCheckProcFactory.DefaultExprProcessor.isRedundantConversionFunction(ASTNode expr,
boolean isFunction,
ArrayList<ExprNodeDesc> children) |
void |
RuntimeValuesInfo.setColExprs(List<ExprNodeDesc> colExprs) |
void |
ParseContext.setColExprToGBMap(Map<ExprNodeDesc,GroupByOperator> colExprToGBMap) |
void |
ParseContext.setOpPartToSkewedPruner(HashMap<TableScanOperator,Map<String,ExprNodeDesc>> opToPartToSkewedPruner) |
void |
ParseContext.setOpToPartPruner(HashMap<TableScanOperator,ExprNodeDesc> opToPartPruner) |
protected void |
TypeCheckProcFactory.DefaultExprProcessor.validateUDF(ASTNode expr,
boolean isFunction,
TypeCheckCtx ctx,
FunctionInfo fi,
List<ExprNodeDesc> children,
GenericUDF genericUDF) |
Constructor and Description |
---|
DynamicListContext(ExprNodeDynamicListDesc desc,
ExprNodeDesc parent,
ExprNodeDesc grandParent,
ReduceSinkOperator generator) |
Modifier and Type | Method and Description |
---|---|
void |
SparkPartitionPruningSinkOperator.addAsSourceEvent(MapWork mapWork,
ExprNodeDesc partKey,
String columnName,
String columnType)
Add this DPP sink as a pruning source for the target MapWork.
|
void |
SparkPartitionPruningSinkOperator.removeFromSourceEvent(MapWork mapWork,
ExprNodeDesc partKey,
String columnName,
String columnType)
Remove this DPP sink from the target MapWork's pruning source.
|
Modifier and Type | Class and Description |
---|---|
class |
ExprNodeColumnDesc
ExprNodeColumnDesc.
|
class |
ExprNodeColumnListDesc
Dummy desc only for populating TOK_ALLCOLREF and should not be used
outside of TypeCheckProcFactory
|
class |
ExprNodeConstantDesc
A constant expression.
|
class |
ExprNodeDynamicListDesc
This expression represents a list that will be available at runtime.
|
class |
ExprNodeDynamicValueDesc
This expression represents a value that will be available at runtime.
|
class |
ExprNodeFieldDesc
ExprNodeFieldDesc.
|
class |
ExprNodeGenericFuncDesc
Describes a GenericFunc node.
|
class |
ExprNodeSubQueryDesc
This encapsulate subquery expression which consists of
Relnode for subquery.
|
Modifier and Type | Field and Description |
---|---|
protected Map<String,ExprNodeDesc> |
AbstractOperatorDesc.colExprMap
A map of output column name to input expression map.
|
Modifier and Type | Method and Description |
---|---|
static ExprNodeDesc |
ExprNodeDescUtils.backtrack(ExprNodeDesc source,
Operator<?> current,
Operator<?> terminal) |
static ExprNodeDesc |
ExprNodeDescUtils.backtrack(ExprNodeDesc source,
Operator<?> current,
Operator<?> terminal,
boolean foldExpr) |
ExprNodeDesc |
ExprNodeDynamicListDesc.clone() |
ExprNodeDesc |
ExprNodeColumnDesc.clone() |
ExprNodeDesc |
ExprNodeColumnListDesc.clone() |
ExprNodeDesc |
ExprNodeFieldDesc.clone() |
abstract ExprNodeDesc |
ExprNodeDesc.clone() |
ExprNodeDesc |
ExprNodeDynamicValueDesc.clone() |
ExprNodeDesc |
ExprNodeConstantDesc.clone() |
ExprNodeDesc |
ExprNodeGenericFuncDesc.clone() |
ExprNodeDesc |
ExprNodeSubQueryDesc.clone() |
static ExprNodeDesc[] |
ExprNodeDescUtils.extractComparePair(ExprNodeDesc expr1,
ExprNodeDesc expr2) |
static ExprNodeDesc |
ExprNodeDescUtils.findConstantExprOrigin(String dpCol,
Operator<? extends OperatorDesc> op) |
static ExprNodeDesc |
ExprNodeDescUtils.flattenExpr(ExprNodeDesc source)
A normal reduce operator's rowObjectInspector looks like a struct containing
nested key/value structs that contain the column values:
{ key: { reducesinkkey0:int }, value: { _col0:int, _col1:int, ..
|
ExprNodeDesc |
CreateMacroDesc.getBody() |
ExprNodeDesc |
ExprNodeFieldDesc.getDesc() |
ExprNodeDesc |
ExprNodeDesc.ExprNodeDescEqualityWrapper.getExprNodeDesc() |
ExprNodeDesc[][] |
JoinDesc.getJoinKeys() |
ExprNodeDesc[] |
VectorPTFDesc.getOrderExprNodeDescs() |
ExprNodeDesc[] |
VectorPTFDesc.getPartitionExprNodeDescs() |
ExprNodeDesc |
DynamicPruningEventDesc.getPartKey() |
ExprNodeDesc |
FilterDesc.getPredicate() |
ExprNodeDesc |
ExprNodeSubQueryDesc.getSubQueryLhs() |
static ExprNodeDesc |
ExprNodeDescUtils.mergePredicates(List<ExprNodeDesc> exprs)
bind n predicates by AND op
|
static ExprNodeDesc |
ExprNodeDescUtils.replace(ExprNodeDesc origin,
List<ExprNodeDesc> sources,
List<ExprNodeDesc> targets) |
static ExprNodeDesc |
ExprNodeDescUtils.resolveJoinKeysAsRSColumns(ExprNodeDesc source,
Operator<?> reduceSinkOp)
Join keys are expressions based on the select operator.
|
Modifier and Type | Method and Description |
---|---|
static ArrayList<ExprNodeDesc> |
ExprNodeDescUtils.backtrack(List<ExprNodeDesc> sources,
Operator<?> current,
Operator<?> terminal)
Convert expressions in current operator to those in terminal operator, which
is an ancestor of current or null (back to top operator).
|
static ArrayList<ExprNodeDesc> |
ExprNodeDescUtils.backtrack(List<ExprNodeDesc> sources,
Operator<?> current,
Operator<?> terminal,
boolean foldExpr) |
static ArrayList<ExprNodeDesc> |
ExprNodeDescUtils.clone(List<ExprNodeDesc> sources) |
static List<ExprNodeDesc> |
ExprNodeDescUtils.flattenExprList(List<ExprNodeDesc> sourceList) |
static ArrayList<ExprNodeDesc> |
ExprNodeDescUtils.genExprNodeDesc(Operator inputOp,
int startPos,
int endPos,
boolean addEmptyTabAlias,
boolean setColToNonVirtual)
Build ExprNodeColumnDesc for the projections in the input operator from
sartpos to endpos(both included).
|
List<ExprNodeDesc> |
ReduceSinkDesc.getBucketCols() |
List<ExprNodeDesc> |
ExprNodeColumnListDesc.getChildren() |
List<ExprNodeDesc> |
ExprNodeFieldDesc.getChildren() |
List<ExprNodeDesc> |
ExprNodeDesc.getChildren() |
List<ExprNodeDesc> |
ExprNodeGenericFuncDesc.getChildren() |
List<ExprNodeDesc> |
SelectDesc.getColList() |
Map<String,ExprNodeDesc> |
AbstractOperatorDesc.getColumnExprMap() |
Map<String,ExprNodeDesc> |
OperatorDesc.getColumnExprMap() |
Map<String,List<ExprNodeDesc>> |
MapWork.getEventSourcePartKeyExprMap() |
Map<Byte,List<ExprNodeDesc>> |
HashTableSinkDesc.getExprs() |
Map<Byte,List<ExprNodeDesc>> |
JoinDesc.getExprs() |
Map<Byte,List<ExprNodeDesc>> |
HashTableSinkDesc.getFilters() |
Map<Byte,List<ExprNodeDesc>> |
JoinDesc.getFilters() |
ArrayList<ExprNodeDesc> |
ReduceSinkDesc.getKeyCols() |
Map<Byte,List<ExprNodeDesc>> |
MapJoinDesc.getKeys() |
Map<Byte,List<ExprNodeDesc>> |
HashTableSinkDesc.getKeys() |
ArrayList<ExprNodeDesc> |
GroupByDesc.getKeys() |
ArrayList<ExprNodeDesc> |
AggregationDesc.getParameters() |
List<List<ExprNodeDesc>> |
MuxDesc.getParentToKeyCols() |
List<List<ExprNodeDesc>> |
MuxDesc.getParentToValueCols() |
ArrayList<ExprNodeDesc> |
FileSinkDesc.getPartitionCols() |
ArrayList<ExprNodeDesc> |
ReduceSinkDesc.getPartitionCols() |
List<ExprNodeDesc> |
JoinDesc.getResidualFilterExprs() |
ArrayList<ExprNodeDesc> |
ReduceSinkDesc.getValueCols() |
static List<ExprNodeDesc> |
ExprNodeDescUtils.resolveJoinKeysAsRSColumns(List<ExprNodeDesc> sourceList,
Operator<?> reduceSinkOp) |
static List<ExprNodeDesc> |
ExprNodeDescUtils.split(ExprNodeDesc current)
split predicates by AND op
|
static List<ExprNodeDesc> |
ExprNodeDescUtils.split(ExprNodeDesc current,
List<ExprNodeDesc> splitted)
split predicates by AND op
|
Modifier and Type | Method and Description |
---|---|
void |
ExprNodeColumnListDesc.addColumn(ExprNodeDesc column) |
static void |
PlanUtils.addExprToStringBuffer(ExprNodeDesc expr,
Appendable sb,
boolean userLevelExplain) |
static void |
PlanUtils.addExprToStringBuffer(ExprNodeDesc expr,
Appendable sb,
boolean userLevelExplain,
boolean sortExpressions) |
static ExprNodeDesc |
ExprNodeDescUtils.backtrack(ExprNodeDesc source,
Operator<?> current,
Operator<?> terminal) |
static ExprNodeDesc |
ExprNodeDescUtils.backtrack(ExprNodeDesc source,
Operator<?> current,
Operator<?> terminal,
boolean foldExpr) |
static boolean |
ExprNodeDescUtils.containsPredicate(ExprNodeDesc source,
ExprNodeDesc predicate)
return true if predicate is already included in source
|
static PrimitiveTypeInfo |
ExprNodeDescUtils.deriveMinArgumentCast(ExprNodeDesc childExpr,
TypeInfo targetType) |
static String |
ExprNodeDescUtils.extractColName(ExprNodeDesc root) |
static ExprNodeDesc[] |
ExprNodeDescUtils.extractComparePair(ExprNodeDesc expr1,
ExprNodeDesc expr2) |
static ExprNodeDescUtils.ColumnOrigin |
ExprNodeDescUtils.findColumnOrigin(ExprNodeDesc expr,
Operator<?> op) |
static ExprNodeDesc |
ExprNodeDescUtils.flattenExpr(ExprNodeDesc source)
A normal reduce operator's rowObjectInspector looks like a struct containing
nested key/value structs that contain the column values:
{ key: { reducesinkkey0:int }, value: { _col0:int, _col1:int, ..
|
static ExprNodeColumnDesc |
ExprNodeDescUtils.getColumnExpr(ExprNodeDesc expr) |
static void |
ExprNodeDescUtils.getExprNodeColumnDesc(ExprNodeDesc exprDesc,
Map<Integer,ExprNodeDesc> hashCodeToColumnDescMap)
Get Map of ExprNodeColumnDesc HashCode to ExprNodeColumnDesc.
|
static int |
ExprNodeDescUtils.indexOf(ExprNodeDesc origin,
List<ExprNodeDesc> sources) |
static boolean |
ExprNodeDescUtils.isConstant(ExprNodeDesc value) |
static boolean |
ExprNodeDescUtils.isDeterministic(ExprNodeDesc desc)
Return false if the expression has any non deterministic function
|
static boolean |
ExprNodeDescUtils.isNullConstant(ExprNodeDesc value) |
static boolean |
ExprNodeDescUtils.isSame(ExprNodeDesc desc1,
ExprNodeDesc desc2) |
static ExprNodeGenericFuncDesc |
ExprNodeDescUtils.mergePredicates(ExprNodeDesc prev,
ExprNodeDesc next)
bind two predicates by AND op
|
static String |
ExprNodeDescUtils.recommendInputName(ExprNodeDesc desc)
Recommend name for the expression
|
static ExprNodeDesc |
ExprNodeDescUtils.replace(ExprNodeDesc origin,
List<ExprNodeDesc> sources,
List<ExprNodeDesc> targets) |
static void |
ExprNodeDescUtils.replaceEqualDefaultPartition(ExprNodeDesc origin,
String defaultPartitionName) |
static ExprNodeDesc |
ExprNodeDescUtils.resolveJoinKeysAsRSColumns(ExprNodeDesc source,
Operator<?> reduceSinkOp)
Join keys are expressions based on the select operator.
|
void |
ExprNodeFieldDesc.setDesc(ExprNodeDesc desc) |
void |
VectorPTFDesc.setOrderExprNodeDescs(ExprNodeDesc[] orderExprNodeDescs) |
void |
VectorPTFDesc.setPartitionExprNodeDescs(ExprNodeDesc[] partitionExprNodeDescs) |
void |
DynamicPruningEventDesc.setPartKey(ExprNodeDesc partKey) |
void |
FilterDesc.setPredicate(ExprNodeDesc predicate) |
static List<ExprNodeDesc> |
ExprNodeDescUtils.split(ExprNodeDesc current)
split predicates by AND op
|
static List<ExprNodeDesc> |
ExprNodeDescUtils.split(ExprNodeDesc current,
List<ExprNodeDesc> splitted)
split predicates by AND op
|
Modifier and Type | Method and Description |
---|---|
static ArrayList<ExprNodeDesc> |
ExprNodeDescUtils.backtrack(List<ExprNodeDesc> sources,
Operator<?> current,
Operator<?> terminal)
Convert expressions in current operator to those in terminal operator, which
is an ancestor of current or null (back to top operator).
|
static ArrayList<ExprNodeDesc> |
ExprNodeDescUtils.backtrack(List<ExprNodeDesc> sources,
Operator<?> current,
Operator<?> terminal,
boolean foldExpr) |
static boolean |
ExprNodeDescUtils.checkPrefixKeys(List<ExprNodeDesc> childKeys,
List<ExprNodeDesc> parentKeys,
Operator<? extends OperatorDesc> childOp,
Operator<? extends OperatorDesc> parentOp)
Checks whether the keys of a parent operator are a prefix of the keys of a
child operator.
|
static boolean |
ExprNodeDescUtils.checkPrefixKeys(List<ExprNodeDesc> childKeys,
List<ExprNodeDesc> parentKeys,
Operator<? extends OperatorDesc> childOp,
Operator<? extends OperatorDesc> parentOp)
Checks whether the keys of a parent operator are a prefix of the keys of a
child operator.
|
static boolean |
ExprNodeDescUtils.checkPrefixKeysUpstream(List<ExprNodeDesc> childKeys,
List<ExprNodeDesc> parentKeys,
Operator<? extends OperatorDesc> childOp,
Operator<? extends OperatorDesc> parentOp)
Checks whether the keys of a child operator are a prefix of the keys of a
parent operator.
|
static boolean |
ExprNodeDescUtils.checkPrefixKeysUpstream(List<ExprNodeDesc> childKeys,
List<ExprNodeDesc> parentKeys,
Operator<? extends OperatorDesc> childOp,
Operator<? extends OperatorDesc> parentOp)
Checks whether the keys of a child operator are a prefix of the keys of a
parent operator.
|
static ArrayList<ExprNodeDesc> |
ExprNodeDescUtils.clone(List<ExprNodeDesc> sources) |
static List<ExprNodeDesc> |
ExprNodeDescUtils.flattenExprList(List<ExprNodeDesc> sourceList) |
static String |
PlanUtils.getExprListString(Collection<? extends ExprNodeDesc> exprs) |
static String |
PlanUtils.getExprListString(Collection<? extends ExprNodeDesc> exprs,
boolean userLevelExplain) |
static String |
PlanUtils.getExprListString(Collection<? extends ExprNodeDesc> exprs,
boolean userLevelExplain,
boolean sortExpressions) |
static void |
ExprNodeDescUtils.getExprNodeColumnDesc(ExprNodeDesc exprDesc,
Map<Integer,ExprNodeDesc> hashCodeToColumnDescMap)
Get Map of ExprNodeColumnDesc HashCode to ExprNodeColumnDesc.
|
static void |
ExprNodeDescUtils.getExprNodeColumnDesc(List<ExprNodeDesc> exprDescList,
Map<Integer,ExprNodeDesc> hashCodeTocolumnDescMap) |
static void |
ExprNodeDescUtils.getExprNodeColumnDesc(List<ExprNodeDesc> exprDescList,
Map<Integer,ExprNodeDesc> hashCodeTocolumnDescMap) |
static List<FieldSchema> |
PlanUtils.getFieldSchemasFromColumnList(List<ExprNodeDesc> cols,
List<String> outputColumnNames,
int start,
String fieldPrefix)
Convert the ColumnList to FieldSchema list.
|
static List<FieldSchema> |
PlanUtils.getFieldSchemasFromColumnList(List<ExprNodeDesc> cols,
String fieldPrefix)
Convert the ColumnList to FieldSchema list.
|
static List<FieldSchema> |
PlanUtils.getFieldSchemasFromColumnListWithLength(List<ExprNodeDesc> cols,
List<List<Integer>> distinctColIndices,
List<String> outputColumnNames,
int length,
String fieldPrefix)
Convert the ColumnList to FieldSchema list.
|
static ReduceSinkDesc |
PlanUtils.getReduceSinkDesc(ArrayList<ExprNodeDesc> keyCols,
ArrayList<ExprNodeDesc> valueCols,
List<String> outputColumnNames,
boolean includeKeyCols,
int tag,
ArrayList<ExprNodeDesc> partitionCols,
String order,
String nullOrder,
int numReducers,
AcidUtils.Operation writeType)
Create the reduce sink descriptor.
|
static ReduceSinkDesc |
PlanUtils.getReduceSinkDesc(ArrayList<ExprNodeDesc> keyCols,
ArrayList<ExprNodeDesc> valueCols,
List<String> outputColumnNames,
boolean includeKeyCols,
int tag,
ArrayList<ExprNodeDesc> partitionCols,
String order,
String nullOrder,
int numReducers,
AcidUtils.Operation writeType)
Create the reduce sink descriptor.
|
static ReduceSinkDesc |
PlanUtils.getReduceSinkDesc(ArrayList<ExprNodeDesc> keyCols,
ArrayList<ExprNodeDesc> valueCols,
List<String> outputColumnNames,
boolean includeKeyCols,
int tag,
ArrayList<ExprNodeDesc> partitionCols,
String order,
String nullOrder,
int numReducers,
AcidUtils.Operation writeType)
Create the reduce sink descriptor.
|
static ReduceSinkDesc |
PlanUtils.getReduceSinkDesc(ArrayList<ExprNodeDesc> keyCols,
ArrayList<ExprNodeDesc> valueCols,
List<String> outputColumnNames,
boolean includeKey,
int tag,
int numPartitionFields,
int numReducers,
AcidUtils.Operation writeType)
Create the reduce sink descriptor.
|
static ReduceSinkDesc |
PlanUtils.getReduceSinkDesc(ArrayList<ExprNodeDesc> keyCols,
ArrayList<ExprNodeDesc> valueCols,
List<String> outputColumnNames,
boolean includeKey,
int tag,
int numPartitionFields,
int numReducers,
AcidUtils.Operation writeType)
Create the reduce sink descriptor.
|
static ReduceSinkDesc |
PlanUtils.getReduceSinkDesc(ArrayList<ExprNodeDesc> keyCols,
int numKeys,
ArrayList<ExprNodeDesc> valueCols,
List<List<Integer>> distinctColIndices,
List<String> outputKeyColumnNames,
List<String> outputValueColumnNames,
boolean includeKeyCols,
int tag,
ArrayList<ExprNodeDesc> partitionCols,
String order,
String nullOrder,
int numReducers,
AcidUtils.Operation writeType)
Create the reduce sink descriptor.
|
static ReduceSinkDesc |
PlanUtils.getReduceSinkDesc(ArrayList<ExprNodeDesc> keyCols,
int numKeys,
ArrayList<ExprNodeDesc> valueCols,
List<List<Integer>> distinctColIndices,
List<String> outputKeyColumnNames,
List<String> outputValueColumnNames,
boolean includeKeyCols,
int tag,
ArrayList<ExprNodeDesc> partitionCols,
String order,
String nullOrder,
int numReducers,
AcidUtils.Operation writeType)
Create the reduce sink descriptor.
|
static ReduceSinkDesc |
PlanUtils.getReduceSinkDesc(ArrayList<ExprNodeDesc> keyCols,
int numKeys,
ArrayList<ExprNodeDesc> valueCols,
List<List<Integer>> distinctColIndices,
List<String> outputKeyColumnNames,
List<String> outputValueColumnNames,
boolean includeKeyCols,
int tag,
ArrayList<ExprNodeDesc> partitionCols,
String order,
String nullOrder,
int numReducers,
AcidUtils.Operation writeType)
Create the reduce sink descriptor.
|
static ReduceSinkDesc |
PlanUtils.getReduceSinkDesc(ArrayList<ExprNodeDesc> keyCols,
int numKeys,
ArrayList<ExprNodeDesc> valueCols,
List<List<Integer>> distinctColIndices,
List<String> outputKeyColumnNames,
List<String> outputValueColumnNames,
boolean includeKey,
int tag,
int numPartitionFields,
int numReducers,
AcidUtils.Operation writeType)
Create the reduce sink descriptor.
|
static ReduceSinkDesc |
PlanUtils.getReduceSinkDesc(ArrayList<ExprNodeDesc> keyCols,
int numKeys,
ArrayList<ExprNodeDesc> valueCols,
List<List<Integer>> distinctColIndices,
List<String> outputKeyColumnNames,
List<String> outputValueColumnNames,
boolean includeKey,
int tag,
int numPartitionFields,
int numReducers,
AcidUtils.Operation writeType)
Create the reduce sink descriptor.
|
static int |
ExprNodeDescUtils.indexOf(ExprNodeDesc origin,
List<ExprNodeDesc> sources) |
static boolean |
ExprNodeDescUtils.isAllConstants(List<ExprNodeDesc> value) |
static boolean |
ExprNodeDescUtils.isSame(List<ExprNodeDesc> first,
List<ExprNodeDesc> second) |
static boolean |
ExprNodeDescUtils.isSame(List<ExprNodeDesc> first,
List<ExprNodeDesc> second) |
static ExprNodeDesc |
ExprNodeDescUtils.mergePredicates(List<ExprNodeDesc> exprs)
bind n predicates by AND op
|
static ExprNodeGenericFuncDesc |
ExprNodeGenericFuncDesc.newInstance(GenericUDF genericUDF,
List<ExprNodeDesc> children) |
static ExprNodeGenericFuncDesc |
ExprNodeGenericFuncDesc.newInstance(GenericUDF genericUDF,
String funcText,
List<ExprNodeDesc> children)
Create a ExprNodeGenericFuncDesc based on the genericUDFClass and the
children parameters.
|
static ExprNodeDesc |
ExprNodeDescUtils.replace(ExprNodeDesc origin,
List<ExprNodeDesc> sources,
List<ExprNodeDesc> targets) |
static ExprNodeDesc |
ExprNodeDescUtils.replace(ExprNodeDesc origin,
List<ExprNodeDesc> sources,
List<ExprNodeDesc> targets) |
static List<ExprNodeDesc> |
ExprNodeDescUtils.resolveJoinKeysAsRSColumns(List<ExprNodeDesc> sourceList,
Operator<?> reduceSinkOp) |
void |
ReduceSinkDesc.setBucketCols(List<ExprNodeDesc> bucketCols) |
void |
ExprNodeGenericFuncDesc.setChildren(List<ExprNodeDesc> children) |
void |
SelectDesc.setColList(List<ExprNodeDesc> colList) |
void |
AbstractOperatorDesc.setColumnExprMap(Map<String,ExprNodeDesc> colExprMap) |
void |
OperatorDesc.setColumnExprMap(Map<String,ExprNodeDesc> colExprMap) |
void |
MapWork.setEventSourcePartKeyExprMap(Map<String,List<ExprNodeDesc>> map) |
void |
HashTableSinkDesc.setExprs(Map<Byte,List<ExprNodeDesc>> exprs) |
void |
JoinDesc.setExprs(Map<Byte,List<ExprNodeDesc>> exprs) |
void |
HashTableSinkDesc.setFilters(Map<Byte,List<ExprNodeDesc>> filters) |
void |
JoinDesc.setFilters(Map<Byte,List<ExprNodeDesc>> filters) |
void |
ReduceSinkDesc.setKeyCols(ArrayList<ExprNodeDesc> keyCols) |
void |
GroupByDesc.setKeys(ArrayList<ExprNodeDesc> keys) |
void |
MapJoinDesc.setKeys(Map<Byte,List<ExprNodeDesc>> keys) |
void |
HashTableSinkDesc.setKeys(Map<Byte,List<ExprNodeDesc>> keys) |
void |
AggregationDesc.setParameters(ArrayList<ExprNodeDesc> parameters) |
void |
MuxDesc.setParentToKeyCols(List<List<ExprNodeDesc>> parentToKeyCols) |
void |
MuxDesc.setParentToValueCols(List<List<ExprNodeDesc>> parentToValueCols) |
void |
FileSinkDesc.setPartitionCols(ArrayList<ExprNodeDesc> partitionCols) |
void |
ReduceSinkDesc.setPartitionCols(ArrayList<ExprNodeDesc> partitionCols) |
void |
JoinDesc.setResidualFilterExprs(List<ExprNodeDesc> residualFilterExprs) |
void |
ReduceSinkDesc.setValueCols(ArrayList<ExprNodeDesc> valueCols) |
static List<ExprNodeDesc> |
ExprNodeDescUtils.split(ExprNodeDesc current,
List<ExprNodeDesc> splitted)
split predicates by AND op
|
static Collection<ExprNodeDesc.ExprNodeDescEqualityWrapper> |
ExprNodeDesc.ExprNodeDescEqualityWrapper.transform(Collection<ExprNodeDesc> descs) |
Constructor and Description |
---|
CreateMacroDesc(String macroName,
List<String> colNames,
List<TypeInfo> colTypes,
ExprNodeDesc body) |
ExprNodeDescEqualityWrapper(ExprNodeDesc exprNodeDesc) |
ExprNodeFieldDesc(TypeInfo typeInfo,
ExprNodeDesc desc,
String fieldName,
Boolean isList) |
ExprNodeSubQueryDesc(TypeInfo typeInfo,
org.apache.calcite.rel.RelNode subQuery,
ExprNodeSubQueryDesc.SubqueryType type,
ExprNodeDesc lhs) |
FilterDesc(ExprNodeDesc predicate,
boolean isSamplingPred) |
FilterDesc(ExprNodeDesc predicate,
boolean isSamplingPred,
FilterDesc.SampleDesc sampleDescr) |
JoinDesc(Map<Byte,List<ExprNodeDesc>> exprs,
List<String> outputColumnNames,
boolean noOuterJoin,
JoinCondDesc[] conds,
Map<Byte,List<ExprNodeDesc>> filters,
ExprNodeDesc[][] joinKeys,
MemoryMonitorInfo memoryMonitorInfo) |
Constructor and Description |
---|
AggregationDesc(String genericUDAFName,
GenericUDAFEvaluator genericUDAFEvaluator,
ArrayList<ExprNodeDesc> parameters,
boolean distinct,
GenericUDAFEvaluator.Mode mode) |
ExprNodeGenericFuncDesc(ObjectInspector oi,
GenericUDF genericUDF,
List<ExprNodeDesc> children) |
ExprNodeGenericFuncDesc(ObjectInspector oi,
GenericUDF genericUDF,
String funcText,
List<ExprNodeDesc> children) |
ExprNodeGenericFuncDesc(TypeInfo typeInfo,
GenericUDF genericUDF,
List<ExprNodeDesc> children) |
ExprNodeGenericFuncDesc(TypeInfo typeInfo,
GenericUDF genericUDF,
String funcText,
List<ExprNodeDesc> children) |
FileSinkDesc(org.apache.hadoop.fs.Path dirName,
TableDesc tableInfo,
boolean compressed,
int destTableId,
boolean multiFileSpray,
boolean canBeMerged,
int numFiles,
int totalFiles,
ArrayList<ExprNodeDesc> partitionCols,
DynamicPartitionCtx dpCtx,
org.apache.hadoop.fs.Path destPath,
Long mmWriteId,
boolean isMmCtas,
boolean isInsertOverwrite) |
GroupByDesc(GroupByDesc.Mode mode,
ArrayList<String> outputColumnNames,
ArrayList<ExprNodeDesc> keys,
ArrayList<AggregationDesc> aggregators,
boolean bucketGroup,
float groupByMemoryUsage,
float memoryThreshold,
List<Long> listGroupingSets,
boolean groupingSetsPresent,
int groupingSetsPosition,
boolean isDistinct) |
GroupByDesc(GroupByDesc.Mode mode,
ArrayList<String> outputColumnNames,
ArrayList<ExprNodeDesc> keys,
ArrayList<AggregationDesc> aggregators,
float groupByMemoryUsage,
float memoryThreshold,
List<Long> listGroupingSets,
boolean groupingSetsPresent,
int groupingSetsPosition,
boolean isDistinct) |
JoinDesc(Map<Byte,List<ExprNodeDesc>> exprs,
List<String> outputColumnNames,
boolean noOuterJoin,
JoinCondDesc[] conds,
Map<Byte,List<ExprNodeDesc>> filters,
ExprNodeDesc[][] joinKeys,
MemoryMonitorInfo memoryMonitorInfo) |
JoinDesc(Map<Byte,List<ExprNodeDesc>> exprs,
List<String> outputColumnNames,
boolean noOuterJoin,
JoinCondDesc[] conds,
Map<Byte,List<ExprNodeDesc>> filters,
ExprNodeDesc[][] joinKeys,
MemoryMonitorInfo memoryMonitorInfo) |
MapJoinDesc(Map<Byte,List<ExprNodeDesc>> keys,
TableDesc keyTblDesc,
Map<Byte,List<ExprNodeDesc>> values,
List<TableDesc> valueTblDescs,
List<TableDesc> valueFilteredTblDescs,
List<String> outputColumnNames,
int posBigTable,
JoinCondDesc[] conds,
Map<Byte,List<ExprNodeDesc>> filters,
boolean noOuterJoin,
String dumpFilePrefix,
MemoryMonitorInfo memoryMonitorInfo,
long inMemoryDataSize) |
MapJoinDesc(Map<Byte,List<ExprNodeDesc>> keys,
TableDesc keyTblDesc,
Map<Byte,List<ExprNodeDesc>> values,
List<TableDesc> valueTblDescs,
List<TableDesc> valueFilteredTblDescs,
List<String> outputColumnNames,
int posBigTable,
JoinCondDesc[] conds,
Map<Byte,List<ExprNodeDesc>> filters,
boolean noOuterJoin,
String dumpFilePrefix,
MemoryMonitorInfo memoryMonitorInfo,
long inMemoryDataSize) |
MapJoinDesc(Map<Byte,List<ExprNodeDesc>> keys,
TableDesc keyTblDesc,
Map<Byte,List<ExprNodeDesc>> values,
List<TableDesc> valueTblDescs,
List<TableDesc> valueFilteredTblDescs,
List<String> outputColumnNames,
int posBigTable,
JoinCondDesc[] conds,
Map<Byte,List<ExprNodeDesc>> filters,
boolean noOuterJoin,
String dumpFilePrefix,
MemoryMonitorInfo memoryMonitorInfo,
long inMemoryDataSize) |
ReduceSinkDesc(ArrayList<ExprNodeDesc> keyCols,
int numDistributionKeys,
ArrayList<ExprNodeDesc> valueCols,
ArrayList<String> outputKeyColumnNames,
List<List<Integer>> distinctColumnIndices,
ArrayList<String> outputValueColumnNames,
int tag,
ArrayList<ExprNodeDesc> partitionCols,
int numReducers,
TableDesc keySerializeInfo,
TableDesc valueSerializeInfo,
AcidUtils.Operation writeType) |
ReduceSinkDesc(ArrayList<ExprNodeDesc> keyCols,
int numDistributionKeys,
ArrayList<ExprNodeDesc> valueCols,
ArrayList<String> outputKeyColumnNames,
List<List<Integer>> distinctColumnIndices,
ArrayList<String> outputValueColumnNames,
int tag,
ArrayList<ExprNodeDesc> partitionCols,
int numReducers,
TableDesc keySerializeInfo,
TableDesc valueSerializeInfo,
AcidUtils.Operation writeType) |
ReduceSinkDesc(ArrayList<ExprNodeDesc> keyCols,
int numDistributionKeys,
ArrayList<ExprNodeDesc> valueCols,
ArrayList<String> outputKeyColumnNames,
List<List<Integer>> distinctColumnIndices,
ArrayList<String> outputValueColumnNames,
int tag,
ArrayList<ExprNodeDesc> partitionCols,
int numReducers,
TableDesc keySerializeInfo,
TableDesc valueSerializeInfo,
AcidUtils.Operation writeType) |
SelectDesc(List<ExprNodeDesc> colList,
List<String> outputColumnNames) |
SelectDesc(List<ExprNodeDesc> colList,
List<String> outputColumnNames,
boolean selectStar) |
Modifier and Type | Method and Description |
---|---|
ExprNodeDesc |
PTFExpressionDef.getExprNode() |
Modifier and Type | Method and Description |
---|---|
void |
PTFExpressionDef.setExprNode(ExprNodeDesc exprNode) |
Modifier and Type | Field and Description |
---|---|
protected ExprNodeDesc |
ExprWalkerInfo.ExprInfo.convertedExpr
new expr for this expression.
|
Modifier and Type | Method and Description |
---|---|
Map<String,List<ExprNodeDesc>> |
ExprWalkerInfo.getFinalCandidates()
Returns the list of pushdown expressions for each alias that appear in the
current operator's RowResolver.
|
Map<ExprNodeDesc,ExprNodeDesc> |
ExprWalkerInfo.getNewToOldExprMap() |
Map<ExprNodeDesc,ExprNodeDesc> |
ExprWalkerInfo.getNewToOldExprMap() |
Map<String,List<ExprNodeDesc>> |
ExprWalkerInfo.getNonFinalCandidates()
Returns list of non-final candidate predicate for each map.
|
Map<String,List<ExprNodeDesc>> |
ExprWalkerInfo.getResidualPredicates(boolean clear) |
Modifier and Type | Method and Description |
---|---|
ExprWalkerInfo.ExprInfo |
ExprWalkerInfo.addExprInfo(ExprNodeDesc expr)
Get additional info for a given expression node if it
exists, or create a new one and store it if it does not
|
void |
ExprWalkerInfo.addFinalCandidate(String alias,
ExprNodeDesc expr) |
void |
ExprWalkerInfo.addNonFinalCandidate(String alias,
ExprNodeDesc expr)
Adds the specified expr as a non-final candidate
|
ExprWalkerInfo.ExprInfo |
ExprWalkerInfo.addOrGetExprInfo(ExprNodeDesc expr)
Get additional info for a given expression node if it
exists, or create a new one and store it if it does not
|
static ExprWalkerInfo |
ExprWalkerProcFactory.extractPushdownPreds(OpWalkerInfo opContext,
Operator<? extends OperatorDesc> op,
ExprNodeDesc pred) |
ExprWalkerInfo.ExprInfo |
ExprWalkerInfo.getExprInfo(ExprNodeDesc expr)
Get additional info for a given expression node
|
Modifier and Type | Method and Description |
---|---|
void |
ExprWalkerInfo.addPushDowns(String alias,
List<ExprNodeDesc> pushDowns)
Adds the passed list of pushDowns for the alias.
|
protected static Object |
OpProcFactory.createFilter(Operator op,
Map<String,List<ExprNodeDesc>> predicates,
OpWalkerInfo owi) |
static ExprWalkerInfo |
ExprWalkerProcFactory.extractPushdownPreds(OpWalkerInfo opContext,
Operator<? extends OperatorDesc> op,
List<ExprNodeDesc> preds)
Extracts pushdown predicates from the given list of predicate expression.
|
Modifier and Type | Method and Description |
---|---|
static ColStatistics |
StatsUtils.getColStatisticsFromExpression(HiveConf conf,
Statistics parentStats,
ExprNodeDesc end)
Get column statistics expression nodes
|
Modifier and Type | Method and Description |
---|---|
static List<ColStatistics> |
StatsUtils.getColStatisticsFromExprMap(HiveConf conf,
Statistics parentStats,
Map<String,ExprNodeDesc> colExprMap,
RowSchema rowSchema)
Get column statistics from parent statistics.
|
Modifier and Type | Method and Description |
---|---|
ExprNodeDesc |
GenericUDFMacro.getBody() |
Modifier and Type | Method and Description |
---|---|
void |
GenericUDFMacro.setBody(ExprNodeDesc bodyDesc) |
Modifier and Type | Method and Description |
---|---|
static TypeInfo |
GenericUDFUtils.deriveInType(List<ExprNodeDesc> children) |
Constructor and Description |
---|
GenericUDFMacro(String macroName,
ExprNodeDesc bodyDesc,
List<String> colNames,
List<TypeInfo> colTypes) |
Modifier and Type | Method and Description |
---|---|
static ExprNodeDesc |
MatchPath.ResultExpressionParser.buildExprNode(ASTNode expr,
TypeCheckCtx typeCheckCtx) |
Modifier and Type | Method and Description |
---|---|
ArrayList<ExprNodeDesc> |
MatchPath.ResultExprInfo.getResultExprNodes() |
Modifier and Type | Method and Description |
---|---|
void |
MatchPath.ResultExprInfo.setResultExprNodes(ArrayList<ExprNodeDesc> resultExprNodes) |
Copyright © 2022 The Apache Software Foundation. All rights reserved.