@InterfaceAudience.Private public class Metrics extends Object implements Serializable
Modifier and Type | Field and Description |
---|---|
long |
diskBytesSpilled
The number of on-disk bytes spilled by tasks.
|
long |
executorCpuTime
CPU time the executor spends running the task (including fetching shuffle data).
|
long |
executorDeserializeCpuTime
CPU time taken on the executor to deserialize tasks.
|
long |
executorDeserializeTime
Time taken on the executor to deserialize tasks.
|
long |
executorRunTime
Time the executor spends actually running the task (including fetching shuffle data).
|
InputMetrics |
inputMetrics
If tasks read from a HadoopRDD or from persisted data, metrics on how much data was read.
|
long |
jvmGCTime
Amount of time the JVM spent in garbage collection while executing tasks.
|
long |
memoryBytesSpilled
The number of in-memory bytes spilled by tasks.
|
long |
resultSerializationTime
Amount of time spent serializing task results.
|
long |
resultSize
The number of bytes sent back to the driver by tasks.
|
ShuffleReadMetrics |
shuffleReadMetrics
If tasks read from shuffle output, metrics on getting shuffle data.
|
ShuffleWriteMetrics |
shuffleWriteMetrics
If tasks wrote to shuffle output, metrics on the written shuffle data.
|
long |
taskDurationTime
Amount of time spent executing tasks.
|
Constructor and Description |
---|
Metrics(long executorDeserializeTime,
long executorDeserializeCpuTime,
long executorRunTime,
long executorCpuTime,
long resultSize,
long jvmGCTime,
long resultSerializationTime,
long memoryBytesSpilled,
long diskBytesSpilled,
long taskDurationTime,
InputMetrics inputMetrics,
ShuffleReadMetrics shuffleReadMetrics,
ShuffleWriteMetrics shuffleWriteMetrics) |
Metrics(org.apache.spark.executor.TaskMetrics metrics,
org.apache.spark.scheduler.TaskInfo taskInfo) |
public final long executorDeserializeTime
public final long executorDeserializeCpuTime
public final long executorRunTime
public final long executorCpuTime
public final long resultSize
public final long jvmGCTime
public final long resultSerializationTime
public final long memoryBytesSpilled
public final long diskBytesSpilled
public final long taskDurationTime
public final InputMetrics inputMetrics
public final ShuffleReadMetrics shuffleReadMetrics
public final ShuffleWriteMetrics shuffleWriteMetrics
public Metrics(long executorDeserializeTime, long executorDeserializeCpuTime, long executorRunTime, long executorCpuTime, long resultSize, long jvmGCTime, long resultSerializationTime, long memoryBytesSpilled, long diskBytesSpilled, long taskDurationTime, InputMetrics inputMetrics, ShuffleReadMetrics shuffleReadMetrics, ShuffleWriteMetrics shuffleWriteMetrics)
public Metrics(org.apache.spark.executor.TaskMetrics metrics, org.apache.spark.scheduler.TaskInfo taskInfo)
Copyright © 2022 The Apache Software Foundation. All rights reserved.