org.apache.hadoop.hive.ql.exec.spark

Class SparkTask

java.lang.Object

org.apache.hadoop.hive.ql.exec.Task<SparkWork>

org.apache.hadoop.hive.ql.exec.spark.SparkTask

All Implemented Interfaces:

Serializable, Node

public class SparkTask
extends Task<SparkWork>

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Task

Task.FeedType

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.exec.Task

BACKUP_COMMON_JOIN, backupChildrenTasks, backupTask, childTasks, clonedConf, COMMON_JOIN, conf, CONVERTED_MAPJOIN, CONVERTED_MAPJOIN_LOCAL, CONVERTED_SORTMERGEJOIN, db, driverContext, feedSubscribers, HINTED_MAPJOIN, HINTED_MAPJOIN_LOCAL, id, initialized, isdone, jobID, MAPJOIN_ONLY_NOBACKUP, NO_TAG, parentTasks, queryPlan, queued, rootTask, started, taskCounters, taskHandle, taskTag, work

Constructor Summary

Constructors

Constructor and Description
SparkTask()

Method Summary

Methods

Modifier and Type	Method and Description
int	execute(DriverContext driverContext) This method is overridden in each Task.
Collection<MapWork>	getMapWork()
String	getName() Gets the name of the node.
Operator<? extends OperatorDesc>	getReducer(MapWork mapWork)
SparkCounters	getSparkCounters()
StageType	getType() Should be overridden to return the type of the specific task among the types in StageType.
void	initialize(HiveConf conf, QueryPlan queryPlan, DriverContext driverContext)
boolean	isMapRedTask()

Methods inherited from class org.apache.hadoop.hive.ql.exec.Task

addDependentTask, cloneConf, done, equals, executeTask, getAndInitBackupTask, getBackupChildrenTasks, getBackupTask, getChildren, getChildTasks, getCounters, getDependentTasks, getFeedSubscribers, getId, getInitialized, getJobID, getNumChild, getNumParent, getParentTasks, getQueryPlan, getQueued, getTaskHandle, getTaskTag, getTopOperators, getWork, hashCode, hasReduce, ifRetryCmdWhenFail, isFetchSource, isLocalMode, isMapRedLocalTask, isRootTask, isRunnable, pushFeed, receiveFeed, removeDependentTask, removeFromChildrenTasks, requireLock, setBackupChildrenTasks, setBackupTask, setChildTasks, setConsole, setDone, setException, setFeedSubscribers, setFetchSource, setId, setInitialized, setLocalMode, setParentTasks, setQueryPlan, setQueued, setRetryCmdWhenFail, setRootTask, setStarted, setTaskTag, setWork, shutdown, started, subscribeFeed, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

SparkTask

public SparkTask()

Method Detail

initialize

public void initialize(HiveConf conf,
              QueryPlan queryPlan,
              DriverContext driverContext)

Overrides:

initialize in class Task<SparkWork>

execute

public int execute(DriverContext driverContext)

Description copied from class: Task

This method is overridden in each Task. TODO execute should return a TaskHandle.

Specified by:

execute in class Task<SparkWork>

Returns:

status of executing the task

isMapRedTask

public boolean isMapRedTask()

Overrides:

isMapRedTask in class Task<SparkWork>

getType

public StageType getType()

Description copied from class: Task

Should be overridden to return the type of the specific task among the types in StageType.

Specified by:

getType in class Task<SparkWork>

Returns:

StageType.* or null if not overridden

getName

public String getName()

Description copied from interface: Node

Gets the name of the node. This is used in the rule dispatchers.

Returns:

String

getMapWork

public Collection<MapWork> getMapWork()

Overrides:

getMapWork in class Task<SparkWork>

getReducer

public Operator<? extends OperatorDesc> getReducer(MapWork mapWork)

Overrides:

getReducer in class Task<SparkWork>

getSparkCounters

public SparkCounters getSparkCounters()