org.apache.hadoop.hive.hbase

Class HBaseStatsPublisher

java.lang.Object

org.apache.hadoop.hive.hbase.HBaseStatsPublisher

All Implemented Interfaces:

StatsPublisher

public class HBaseStatsPublisher
extends Object
implements StatsPublisher

A class that implements the StatsPublisher interface through HBase.

Constructor Summary

Constructors

Constructor and Description
HBaseStatsPublisher()

Method Summary

Methods

Modifier and Type	Method and Description
boolean	closeConnection() This method closes the connection to the temporary storage.
boolean	connect(org.apache.hadoop.conf.Configuration hiveconf) Does the necessary HBase initializations.
boolean	init(org.apache.hadoop.conf.Configuration hiveconf) Does the necessary HBase initializations.
boolean	publishStat(String rowID, Map<String,String> stats) Writes temporary statistics into HBase;

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HBaseStatsPublisher

public HBaseStatsPublisher()

Method Detail

connect

public boolean connect(org.apache.hadoop.conf.Configuration hiveconf)

Does the necessary HBase initializations.

Specified by:

connect in interface StatsPublisher

Parameters:

hiveconf - HiveConf that contains the connection parameters.

Returns:

true if connection is successful, false otherwise.

publishStat

public boolean publishStat(String rowID,
                  Map<String,String> stats)

Writes temporary statistics into HBase;

Specified by:

publishStat in interface StatsPublisher

Parameters:

rowID - : a string identification the statistics to be published by all mappers/reducers and then gathered. The statID is unique per output partition per task, e.g.,: the output directory name (uniq per FileSinkOperator) + the partition specs (only for dynamic partitions) + taskID (last component of task file)

stats - : a map containing key-value pairs, where key is a string representing the statistic to be published, and value is a string representing the value for the given statistic

Returns:

true if successful, false otherwise

closeConnection

public boolean closeConnection()

Description copied from interface: StatsPublisher

This method closes the connection to the temporary storage.

Specified by:

closeConnection in interface StatsPublisher

init

public boolean init(org.apache.hadoop.conf.Configuration hiveconf)

Does the necessary HBase initializations.

Specified by:

init in interface StatsPublisher

Parameters:

hiveconf - HiveConf that contains the configurations parameters used to connect to intermediate stats database.

Returns:

true if initialization is successful, false otherwise.