public interface StatsPublisher
Modifier and Type | Method and Description |
---|---|
boolean |
closeConnection(StatsCollectionContext context)
This method closes the connection to the temporary storage.
|
boolean |
connect(StatsCollectionContext context)
This method connects to the intermediate statistics database.
|
boolean |
init(StatsCollectionContext context)
This method does the necessary one-time initializations, possibly creating the tables and
database (if not exist).
|
boolean |
publishStat(String fileID,
Map<String,String> stats)
This method publishes a given statistic into a disk storage, possibly HBase or MySQL.
|
boolean init(StatsCollectionContext context)
hconf
- HiveConf that contains the configurations parameters used to connect to
intermediate stats database.boolean connect(StatsCollectionContext context)
hconf
- HiveConf that contains the connection parameters.boolean publishStat(String fileID, Map<String,String> stats)
fileID
- : a string identification the statistics to be published by all mappers/reducers
and then gathered. The statID is unique per output partition per task, e.g.,:
the output directory name (uniq per FileSinkOperator) +
the partition specs (only for dynamic partitions) +
taskID (last component of task file)stats
- : a map containing key-value pairs, where key is a string representing the statistic
to be published,
and value is a string representing the value for the given statisticboolean closeConnection(StatsCollectionContext context)
Copyright © 2016 The Apache Software Foundation. All rights reserved.