public class SpillListener extends java.lang.Object implements SparkListener
SparkListener
that detects whether spills have occurred in Spark jobs.Constructor and Description |
---|
SpillListener() |
Modifier and Type | Method and Description |
---|---|
int |
numSpilledStages() |
void |
onStageCompleted(SparkListenerStageCompleted stageComplete)
Called when a stage completes successfully or fails, with information on the completed stage.
|
void |
onTaskEnd(SparkListenerTaskEnd taskEnd)
Called when a task ends
|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
onApplicationEnd, onApplicationStart, onBlockManagerAdded, onBlockManagerRemoved, onBlockUpdated, onEnvironmentUpdate, onExecutorAdded, onExecutorMetricsUpdate, onExecutorRemoved, onJobEnd, onJobStart, onStageSubmitted, onTaskGettingResult, onTaskStart, onUnpersistRDD
public int numSpilledStages()
public void onTaskEnd(SparkListenerTaskEnd taskEnd)
SparkListener
onTaskEnd
in interface SparkListener
taskEnd
- (undocumented)public void onStageCompleted(SparkListenerStageCompleted stageComplete)
SparkListener
onStageCompleted
in interface SparkListener
stageComplete
- (undocumented)