org.apache.hive.spark.client.metrics

Class Metrics

java.lang.Object

org.apache.hive.spark.client.metrics.Metrics

All Implemented Interfaces:

Serializable

@InterfaceAudience.Private
public class Metrics
extends Object
implements Serializable

Metrics tracked during the execution of a job. Depending on how the metrics object is obtained (by calling methods in the `MetricsCollection` class), metrics will refer to one or more tasks.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
long	diskBytesSpilled The number of on-disk bytes spilled by tasks.
long	executorDeserializeTime Time taken on the executor to deserialize tasks.
long	executorRunTime Time the executor spends actually running the task (including fetching shuffle data).
InputMetrics	inputMetrics If tasks read from a HadoopRDD or from persisted data, metrics on how much data was read.
long	jvmGCTime Amount of time the JVM spent in garbage collection while executing tasks.
long	memoryBytesSpilled The number of in-memory bytes spilled by tasks.
long	resultSerializationTime Amount of time spent serializing task results.
long	resultSize The number of bytes sent back to the driver by tasks.
ShuffleReadMetrics	shuffleReadMetrics If tasks read from shuffle output, metrics on getting shuffle data.
ShuffleWriteMetrics	shuffleWriteMetrics If tasks wrote to shuffle output, metrics on the written shuffle data.

Constructor Summary

Constructors

Constructor and Description
Metrics(long executorDeserializeTime, long executorRunTime, long resultSize, long jvmGCTime, long resultSerializationTime, long memoryBytesSpilled, long diskBytesSpilled, InputMetrics inputMetrics, ShuffleReadMetrics shuffleReadMetrics, ShuffleWriteMetrics shuffleWriteMetrics)
Metrics(org.apache.spark.executor.TaskMetrics metrics)

Method Summary

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

executorDeserializeTime

public final long executorDeserializeTime

Time taken on the executor to deserialize tasks.

executorRunTime

public final long executorRunTime

Time the executor spends actually running the task (including fetching shuffle data).

resultSize

public final long resultSize

The number of bytes sent back to the driver by tasks.

jvmGCTime

public final long jvmGCTime

Amount of time the JVM spent in garbage collection while executing tasks.

resultSerializationTime

public final long resultSerializationTime

Amount of time spent serializing task results.

memoryBytesSpilled

public final long memoryBytesSpilled

The number of in-memory bytes spilled by tasks.

diskBytesSpilled

public final long diskBytesSpilled

The number of on-disk bytes spilled by tasks.

inputMetrics

public final InputMetrics inputMetrics

If tasks read from a HadoopRDD or from persisted data, metrics on how much data was read.

shuffleReadMetrics

public final ShuffleReadMetrics shuffleReadMetrics

If tasks read from shuffle output, metrics on getting shuffle data. This includes read metrics aggregated over all the tasks' shuffle dependencies.

shuffleWriteMetrics

public final ShuffleWriteMetrics shuffleWriteMetrics

If tasks wrote to shuffle output, metrics on the written shuffle data.

Constructor Detail

Metrics

public Metrics(long executorDeserializeTime,
       long executorRunTime,
       long resultSize,
       long jvmGCTime,
       long resultSerializationTime,
       long memoryBytesSpilled,
       long diskBytesSpilled,
       InputMetrics inputMetrics,
       ShuffleReadMetrics shuffleReadMetrics,
       ShuffleWriteMetrics shuffleWriteMetrics)

Metrics

public Metrics(org.apache.spark.executor.TaskMetrics metrics)