/[Apache-SVN]
ViewVC logotype

Revision 1211746


Jump to revision: Previous Next
Author: nspiegelberg
Date: Thu Dec 8 02:38:27 2011 UTC (12 years, 10 months ago)
Changed paths: 36
Log Message:
[jira] [HBASE-4908] HBase cluster test tool (port from 0.89-fb)

Summary:
Porting one of our HBase cluster test tools (a single-process multi-threaded
load generator and verifier) from 0.89-fb to trunk.
I cleaned up the code a bit compared to what's in 0.89-fb, and discovered that
it has some features that I have not tried yet (some kind of a kill test, and
some way to run HBase as multiple processes on one machine).
The main utility of this piece of code for us has been the HBaseClusterTest
command-line tool (called HBaseTest in 0.89-fb), which we usually invoke as a
load test in our five-node dev cluster testing, e.g.:

hbase org.apache.hadoop.hbase.util.LoadTestTool -write 50:100:20 -tn loadtest4
-read 100:10 -zk <zk_quorum_node> -bloom ROWCOL -compression LZO -key_window 5
-max_read_errors 10000 -num_keys 10000000000 -start_key 0

Test Plan:
Run this on a dev cluster. Run all unit tests.

Reviewers: stack, Karthik, Kannan, nspiegelberg, JIRA

Reviewed By: nspiegelberg

CC: stack, nspiegelberg, mbautin, Karthik

Differential Revision: 549

Changed paths

Path Details
Directoryhbase/trunk/pom.xml modified , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/EmptyWatcher.java
(Copied from hbase/trunk/src/test/java/org/apache/hadoop/hbase/EmptyWatcher.java, r1211719)
added , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/HConstants.java modified , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java modified , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/mapreduce/HFileOutputFormat.java modified , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/CompactSplitThread.java modified , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/ConstantSizeRegionSplitPolicy.java modified , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java modified , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/wal/SequenceFileLogReader.java modified , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/util/AbstractHBaseTool.java added
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/util/Bytes.java modified , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/util/HMerge.java modified , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/util/Keying.java modified , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/util/RegionSplitter.java modified , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKConfig.java modified , text changed
Directoryhbase/trunk/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java modified , text changed
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/EmptyWatcher.java deleted
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java modified , text changed
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/client/TestAdmin.java modified , text changed
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/coprocessor/TestCoprocessorInterface.java modified , text changed
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat.java modified , text changed
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java modified , text changed
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionSplitPolicy.java modified , text changed
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java modified , text changed
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/util/LoadTestKVGenerator.java added
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/util/LoadTestTool.java added
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/util/MultiThreadedAction.java added
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/util/MultiThreadedReader.java added
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/util/MultiThreadedWriter.java added
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/util/ProcessBasedLocalHBaseCluster.java added
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/util/RestartMetaTest.java added
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/util/TestBytes.java modified , text changed
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/util/TestLoadTestKVGenerator.java added
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/util/TestMergeTable.java modified , text changed
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/util/TestMiniClusterLoadParallel.java added
Directoryhbase/trunk/src/test/java/org/apache/hadoop/hbase/util/TestMiniClusterLoadSequential.java added

infrastructure at apache.org
ViewVC Help
Powered by ViewVC 1.1.26