org.apache.hadoop.hive.ql.exec.spark

Class SparkReporter

java.lang.Object

org.apache.hadoop.hive.ql.exec.spark.SparkReporter

All Implemented Interfaces:

Serializable, org.apache.hadoop.mapred.Reporter, org.apache.hadoop.util.Progressable

public class SparkReporter
extends Object
implements org.apache.hadoop.mapred.Reporter, Serializable

Implement SparkReporter for Hive operator level statistics collection, and throw UnsupportedOperationException for other unrelated methods, so if any Hive feature depends on these unimplemented methods, we could go back here quickly and enable it.

See Also:

Serialized Form

Field Summary

Fields inherited from interface org.apache.hadoop.mapred.Reporter

NULL

Constructor Summary

Constructors

Constructor and Description
SparkReporter(SparkCounters sparkCounters)

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapred.Counters.Counter	getCounter(Enum<?> name)
org.apache.hadoop.mapred.Counters.Counter	getCounter(String group, String name)
org.apache.hadoop.mapred.InputSplit	getInputSplit()
float	getProgress()
String	getStatus()
void	incrCounter(Enum<?> key, long amount)
void	incrCounter(String group, String counter, long amount)
void	progress()
void	setStatus(String status)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkReporter

public SparkReporter(SparkCounters sparkCounters)

Method Detail

setStatus

public void setStatus(String status)

Specified by:

setStatus in interface org.apache.hadoop.mapred.Reporter

getStatus

public String getStatus()

getCounter

public org.apache.hadoop.mapred.Counters.Counter getCounter(Enum<?> name)

Specified by:

getCounter in interface org.apache.hadoop.mapred.Reporter

getCounter

public org.apache.hadoop.mapred.Counters.Counter getCounter(String group,
                                                   String name)

Specified by:

getCounter in interface org.apache.hadoop.mapred.Reporter

incrCounter

public void incrCounter(Enum<?> key,
               long amount)

Specified by:

incrCounter in interface org.apache.hadoop.mapred.Reporter

incrCounter

public void incrCounter(String group,
               String counter,
               long amount)

Specified by:

incrCounter in interface org.apache.hadoop.mapred.Reporter

getInputSplit

public org.apache.hadoop.mapred.InputSplit getInputSplit()

Specified by:

getInputSplit in interface org.apache.hadoop.mapred.Reporter

getProgress

public float getProgress()

Specified by:

getProgress in interface org.apache.hadoop.mapred.Reporter

progress

public void progress()

Specified by:

progress in interface org.apache.hadoop.util.Progressable