org.apache.hadoop.hive.ql.parse

Class GenTezUtils

java.lang.Object

org.apache.hadoop.hive.ql.parse.GenTezUtils

public class GenTezUtils
extends Object

GenTezUtils is a collection of shared helper methods to produce TezWork

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	GenTezUtils()

Method Summary

Methods

Modifier and Type	Method and Description
MapWork	createMapWork(GenTezProcContext context, Operator<?> root, TezWork tezWork, PrunedPartitionList partitions)
ReduceWork	createReduceWork(GenTezProcContext context, Operator<?> root, TezWork tezWork)
UnionWork	createUnionWork(GenTezProcContext context, Operator<?> root, Operator<?> leaf, TezWork tezWork)
BaseWork	getEnclosingWork(Operator<?> op, GenTezProcContext procCtx) getEncosingWork finds the BaseWork any given operator belongs to.
static GenTezUtils	getUtils()
void	processAppMasterEvent(GenTezProcContext procCtx, AppMasterEventOperator event) processAppMasterEvent sets up the event descriptor and the MapWork.
void	processFileSink(GenTezProcContext context, FileSinkOperator fileSink)
void	removeBranch(AppMasterEventOperator event) Remove an operator branch.
void	removeUnionOperators(org.apache.hadoop.conf.Configuration conf, GenTezProcContext context, BaseWork work)
void	resetSequenceNumber()
protected void	setupMapWork(MapWork mapWork, GenTezProcContext context, PrunedPartitionList partitions, Operator<? extends OperatorDesc> root, String alias)
protected void	setupReduceSink(GenTezProcContext context, ReduceWork reduceWork, ReduceSinkOperator reduceSink)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GenTezUtils

protected GenTezUtils()

Method Detail

getUtils

public static GenTezUtils getUtils()

resetSequenceNumber

public void resetSequenceNumber()

createUnionWork

public UnionWork createUnionWork(GenTezProcContext context,
                        Operator<?> root,
                        Operator<?> leaf,
                        TezWork tezWork)

createReduceWork

public ReduceWork createReduceWork(GenTezProcContext context,
                          Operator<?> root,
                          TezWork tezWork)

setupReduceSink

protected void setupReduceSink(GenTezProcContext context,
                   ReduceWork reduceWork,
                   ReduceSinkOperator reduceSink)

createMapWork

public MapWork createMapWork(GenTezProcContext context,
                    Operator<?> root,
                    TezWork tezWork,
                    PrunedPartitionList partitions)
                      throws SemanticException

Throws:

SemanticException

setupMapWork

protected void setupMapWork(MapWork mapWork,
                GenTezProcContext context,
                PrunedPartitionList partitions,
                Operator<? extends OperatorDesc> root,
                String alias)
                     throws SemanticException

Throws:

SemanticException

removeUnionOperators

public void removeUnionOperators(org.apache.hadoop.conf.Configuration conf,
                        GenTezProcContext context,
                        BaseWork work)
                          throws SemanticException

Throws:

SemanticException

processFileSink

public void processFileSink(GenTezProcContext context,
                   FileSinkOperator fileSink)
                     throws SemanticException

Throws:

SemanticException

processAppMasterEvent

public void processAppMasterEvent(GenTezProcContext procCtx,
                         AppMasterEventOperator event)

processAppMasterEvent sets up the event descriptor and the MapWork.

Parameters:

procCtx -

event -

getEnclosingWork

public BaseWork getEnclosingWork(Operator<?> op,
                        GenTezProcContext procCtx)

getEncosingWork finds the BaseWork any given operator belongs to.

removeBranch

public void removeBranch(AppMasterEventOperator event)

Remove an operator branch. When we see a fork, we know it's time to do the removal.

Parameters:

event - the leaf node of which branch to be removed