org.apache.hive.spark.client

Class MetricsCollection

java.lang.Object

org.apache.hive.spark.client.MetricsCollection

@InterfaceAudience.Private
public class MetricsCollection
extends Object

Provides metrics collected for a submitted job. The collected metrics can be analysed at different levels of granularity: - Global (all Spark jobs triggered by client job) - Spark job - Stage - Task Only successful, non-speculative tasks are considered. Metrics are updated as tasks finish, so snapshots can be retrieved before the whole job completes.

Constructor Summary

Constructors

Constructor and Description
MetricsCollection()

Method Summary

Methods

Modifier and Type	Method and Description
Metrics	getAllMetrics()
Set<Integer>	getJobIds()
Metrics	getJobMetrics(int jobId)
Set<Integer>	getStageIds(int jobId)
Metrics	getStageMetrics(int jobId, int stageId)
Set<Long>	getTaskIds(int jobId, int stageId)
Metrics	getTaskMetrics(int jobId, int stageId, long taskId)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MetricsCollection

public MetricsCollection()

Method Detail

getAllMetrics

public Metrics getAllMetrics()

getJobIds

public Set<Integer> getJobIds()

getJobMetrics

public Metrics getJobMetrics(int jobId)

getStageIds

public Set<Integer> getStageIds(int jobId)

getStageMetrics

public Metrics getStageMetrics(int jobId,
                      int stageId)

getTaskIds

public Set<Long> getTaskIds(int jobId,
                   int stageId)

getTaskMetrics

public Metrics getTaskMetrics(int jobId,
                     int stageId,
                     long taskId)