org.apache.hadoop.hive.ql.parse.spark

Class GenSparkWork

java.lang.Object

org.apache.hadoop.hive.ql.parse.spark.GenSparkWork

All Implemented Interfaces:

NodeProcessor

public class GenSparkWork
extends Object
implements NodeProcessor

GenSparkWork separates the operator tree into spark tasks. It is called once per leaf operator (operator that forces a new execution unit.) and break the operators into work and tasks along the way. Cloned from GenTezWork.

Constructor Summary

Constructors

Constructor and Description
GenSparkWork(GenSparkUtils utils) Constructor takes utils as parameter to facilitate testing

Method Summary

Methods

Modifier and Type	Method and Description
Object	process(Node nd, Stack<Node> stack, NodeProcessorCtx procContext, Object... nodeOutputs) Generic process for all ops that don't have specific implementations.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GenSparkWork

public GenSparkWork(GenSparkUtils utils)

Constructor takes utils as parameter to facilitate testing

Method Detail

process

public Object process(Node nd,
             Stack<Node> stack,
             NodeProcessorCtx procContext,
             Object... nodeOutputs)
               throws SemanticException

Description copied from interface: NodeProcessor

Generic process for all ops that don't have specific implementations.

Specified by:

process in interface NodeProcessor

Parameters:

nd - operator to process

procContext - operator processor context

nodeOutputs - A variable argument list of outputs from other nodes in the walk

Returns:

Object to be returned by the process call

Throws:

SemanticException