/[Apache-SVN]
ViewVC logotype

Revision 1208885


Jump to revision: Previous Next
Author: karthik
Date: Wed Nov 30 23:42:21 2011 UTC (12 years, 10 months ago)
Changed paths: 5
Log Message:
HBASE-4463 [jira] Run more aggressive compactions during off peak hours

Summary:
HBASE-4463 Run more aggressive compactions during off peak hours

Increases the compact selection ratio from 1.3 to 5 at off-peak hours. This
will help utilize the available iops and bandwidth to decrease average num of
files per store. Only one such aggressive compaction is queued per store at any
point.

The number of iops on the disk and the top of the rack bandwidth utilization at
off peak hours is much lower than at peak hours depending on the application
usage pattern. We can utilize this knowledge to improve the performance of the
HBase cluster by increasing the compact selection ratio to a much larger value
during off-peak hours than otherwise - increasing hbase.hstore.compaction.ratio
(1.2 default) to hbase.hstore.compaction.ratio.offpeak (5 default). This will
help reduce the average number of files per store.

Test Plan: Started running the unit tests.

Reviewers: JIRA, Kannan, nspiegelberg, mbautin, stack

Reviewed By: nspiegelberg

CC: nspiegelberg, tedyu, lhofhansl, Karthik

Differential Revision: 471

Changed paths

Path Details
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java modified , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java modified , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/CompactSelection.java added
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/CompactionRequest.java modified , text changed
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactSelection.java modified , text changed

infrastructure at apache.org
ViewVC Help
Powered by ViewVC 1.1.26