org.apache.hadoop.hive.ql.exec.spark.status

Class LocalSparkJobMonitor

java.lang.Object

org.apache.hadoop.hive.ql.exec.spark.status.LocalSparkJobMonitor

public class LocalSparkJobMonitor
extends Object

LocalSparkJobMonitor monitor a single Spark job status in a loop until job finished/failed/killed. It print current job status to console and sleep current thread between monitor interval.

Field Summary

Fields

Modifier and Type	Field and Description
protected int	checkInterval
protected static String	CLASS_NAME
protected static SessionState.LogHelper	console
protected static org.apache.commons.logging.Log	LOG
protected long	monitorTimeoutInteval
protected PerfLogger	perfLogger

Constructor Summary

Constructors

Constructor and Description
LocalSparkJobMonitor(HiveConf hiveConf, SparkJobStatus sparkJobStatus)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	printStatus(Map<String,SparkStageProgress> progressMap, Map<String,SparkStageProgress> lastProgressMap)
int	startMonitor()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CLASS_NAME

protected static final String CLASS_NAME

LOG

protected static final org.apache.commons.logging.Log LOG

console

protected static SessionState.LogHelper console

perfLogger

protected final PerfLogger perfLogger

checkInterval

protected final int checkInterval

See Also:

Constant Field Values

monitorTimeoutInteval

protected final long monitorTimeoutInteval

Constructor Detail

LocalSparkJobMonitor

public LocalSparkJobMonitor(HiveConf hiveConf,
                    SparkJobStatus sparkJobStatus)

Method Detail

startMonitor

public int startMonitor()

printStatus

protected void printStatus(Map<String,SparkStageProgress> progressMap,
               Map<String,SparkStageProgress> lastProgressMap)