PREHOOK: query: DROP TABLE hbase_table_1 PREHOOK: type: DROPTABLE POSTHOOK: query: DROP TABLE hbase_table_1 POSTHOOK: type: DROPTABLE PREHOOK: query: CREATE TABLE hbase_table_1(key int, value string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = "cf:string") TBLPROPERTIES ("hbase.table.name" = "hbase_table_0") PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@hbase_table_1 POSTHOOK: query: CREATE TABLE hbase_table_1(key int, value string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = "cf:string") TBLPROPERTIES ("hbase.table.name" = "hbase_table_0") POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@hbase_table_1 PREHOOK: query: DESCRIBE EXTENDED hbase_table_1 PREHOOK: type: DESCTABLE PREHOOK: Input: default@hbase_table_1 POSTHOOK: query: DESCRIBE EXTENDED hbase_table_1 POSTHOOK: type: DESCTABLE POSTHOOK: Input: default@hbase_table_1 key int from deserializer value string from deserializer #### A masked pattern was here #### PREHOOK: query: select * from hbase_table_1 PREHOOK: type: QUERY PREHOOK: Input: default@hbase_table_1 #### A masked pattern was here #### POSTHOOK: query: select * from hbase_table_1 POSTHOOK: type: QUERY POSTHOOK: Input: default@hbase_table_1 #### A masked pattern was here #### PREHOOK: query: EXPLAIN FROM src INSERT OVERWRITE TABLE hbase_table_1 SELECT * WHERE (key%2)=0 PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN FROM src INSERT OVERWRITE TABLE hbase_table_1 SELECT * WHERE (key%2)=0 POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-0 is a root stage STAGE PLANS: Stage: Stage-0 Map Reduce Map Operator Tree: TableScan alias: src Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: ((UDFToDouble(key) % 2.0) = 0.0) (type: boolean) Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: UDFToInteger(key) (type: int), value (type: string) outputColumnNames: _col0, _col1 Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat output format: org.apache.hadoop.hive.hbase.HiveHBaseTableOutputFormat serde: org.apache.hadoop.hive.hbase.HBaseSerDe name: default.hbase_table_1 PREHOOK: query: FROM src INSERT OVERWRITE TABLE hbase_table_1 SELECT * WHERE (key%2)=0 PREHOOK: type: QUERY PREHOOK: Input: default@src PREHOOK: Output: default@hbase_table_1 POSTHOOK: query: FROM src INSERT OVERWRITE TABLE hbase_table_1 SELECT * WHERE (key%2)=0 POSTHOOK: type: QUERY POSTHOOK: Input: default@src POSTHOOK: Output: default@hbase_table_1 PREHOOK: query: DROP TABLE hbase_table_2 PREHOOK: type: DROPTABLE POSTHOOK: query: DROP TABLE hbase_table_2 POSTHOOK: type: DROPTABLE PREHOOK: query: CREATE EXTERNAL TABLE hbase_table_2(key int, value string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = "cf:string") TBLPROPERTIES ("hbase.table.name" = "hbase_table_0") PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@hbase_table_2 POSTHOOK: query: CREATE EXTERNAL TABLE hbase_table_2(key int, value string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = "cf:string") TBLPROPERTIES ("hbase.table.name" = "hbase_table_0") POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@hbase_table_2 PREHOOK: query: EXPLAIN SELECT Y.* FROM (SELECT hbase_table_1.* FROM hbase_table_1) x JOIN (SELECT src.* FROM src) Y ON (x.key = Y.key) ORDER BY key, value LIMIT 20 PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT Y.* FROM (SELECT hbase_table_1.* FROM hbase_table_1) x JOIN (SELECT src.* FROM src) Y ON (x.key = Y.key) ORDER BY key, value LIMIT 20 POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-1 is a root stage Stage-2 depends on stages: Stage-1 Stage-0 depends on stages: Stage-2 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: hbase_table_1 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Filter Operator predicate: UDFToDouble(key) is not null (type: boolean) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Select Operator expressions: key (type: int) outputColumnNames: _col0 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Reduce Output Operator key expressions: UDFToDouble(_col0) (type: double) sort order: + Map-reduce partition columns: UDFToDouble(_col0) (type: double) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE TableScan alias: src Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: UDFToDouble(key) is not null (type: boolean) Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: key (type: string), value (type: string) outputColumnNames: _col0, _col1 Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator key expressions: UDFToDouble(_col0) (type: double) sort order: + Map-reduce partition columns: UDFToDouble(_col0) (type: double) Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE value expressions: _col0 (type: string), _col1 (type: string) Reduce Operator Tree: Join Operator condition map: Inner Join 0 to 1 keys: 0 UDFToDouble(_col0) (type: double) 1 UDFToDouble(_col0) (type: double) outputColumnNames: _col2, _col3 Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col2 (type: string), _col3 (type: string) outputColumnNames: _col0, _col1 Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe Stage: Stage-2 Map Reduce Map Operator Tree: TableScan Reduce Output Operator key expressions: _col0 (type: string), _col1 (type: string) sort order: ++ Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE Reduce Operator Tree: Select Operator expressions: KEY.reducesinkkey0 (type: string), KEY.reducesinkkey1 (type: string) outputColumnNames: _col0, _col1 Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE Limit Number of rows: 20 Statistics: Num rows: 20 Data size: 200 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 20 Data size: 200 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Stage: Stage-0 Fetch Operator limit: 20 Processor Tree: ListSink PREHOOK: query: SELECT Y.* FROM (SELECT hbase_table_1.* FROM hbase_table_1) x JOIN (SELECT src.* FROM src) Y ON (x.key = Y.key) ORDER BY key, value LIMIT 20 PREHOOK: type: QUERY PREHOOK: Input: default@hbase_table_1 PREHOOK: Input: default@src #### A masked pattern was here #### POSTHOOK: query: SELECT Y.* FROM (SELECT hbase_table_1.* FROM hbase_table_1) x JOIN (SELECT src.* FROM src) Y ON (x.key = Y.key) ORDER BY key, value LIMIT 20 POSTHOOK: type: QUERY POSTHOOK: Input: default@hbase_table_1 POSTHOOK: Input: default@src #### A masked pattern was here #### 0 val_0 0 val_0 0 val_0 10 val_10 100 val_100 100 val_100 104 val_104 104 val_104 114 val_114 116 val_116 118 val_118 118 val_118 12 val_12 12 val_12 120 val_120 120 val_120 126 val_126 128 val_128 128 val_128 128 val_128 PREHOOK: query: EXPLAIN SELECT Y.* FROM (SELECT hbase_table_1.* FROM hbase_table_1 WHERE 100 < hbase_table_1.key) x JOIN (SELECT hbase_table_2.* FROM hbase_table_2 WHERE hbase_table_2.key < 120) Y ON (x.key = Y.key) ORDER BY key, value PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT Y.* FROM (SELECT hbase_table_1.* FROM hbase_table_1 WHERE 100 < hbase_table_1.key) x JOIN (SELECT hbase_table_2.* FROM hbase_table_2 WHERE hbase_table_2.key < 120) Y ON (x.key = Y.key) ORDER BY key, value POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-1 is a root stage Stage-2 depends on stages: Stage-1 Stage-0 depends on stages: Stage-2 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: hbase_table_1 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Filter Operator predicate: (100 < key) (type: boolean) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Select Operator expressions: key (type: int) outputColumnNames: _col0 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Reduce Output Operator key expressions: _col0 (type: int) sort order: + Map-reduce partition columns: _col0 (type: int) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE TableScan alias: hbase_table_2 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Filter Operator predicate: (key < 120) (type: boolean) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Select Operator expressions: key (type: int), value (type: string) outputColumnNames: _col0, _col1 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Reduce Output Operator key expressions: _col0 (type: int) sort order: + Map-reduce partition columns: _col0 (type: int) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: _col1 (type: string) Reduce Operator Tree: Join Operator condition map: Inner Join 0 to 1 keys: 0 _col0 (type: int) 1 _col0 (type: int) outputColumnNames: _col2, _col3 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Select Operator expressions: _col2 (type: int), _col3 (type: string) outputColumnNames: _col0, _col1 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE File Output Operator compressed: false table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe Stage: Stage-2 Map Reduce Map Operator Tree: TableScan Reduce Output Operator key expressions: _col0 (type: int), _col1 (type: string) sort order: ++ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Reduce Operator Tree: Select Operator expressions: KEY.reducesinkkey0 (type: int), KEY.reducesinkkey1 (type: string) outputColumnNames: _col0, _col1 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Stage: Stage-0 Fetch Operator limit: -1 Processor Tree: ListSink PREHOOK: query: SELECT Y.* FROM (SELECT hbase_table_1.* FROM hbase_table_1 WHERE 100 < hbase_table_1.key) x JOIN (SELECT hbase_table_2.* FROM hbase_table_2 WHERE hbase_table_2.key < 120) Y ON (x.key = Y.key) ORDER BY key,value PREHOOK: type: QUERY PREHOOK: Input: default@hbase_table_1 PREHOOK: Input: default@hbase_table_2 #### A masked pattern was here #### POSTHOOK: query: SELECT Y.* FROM (SELECT hbase_table_1.* FROM hbase_table_1 WHERE 100 < hbase_table_1.key) x JOIN (SELECT hbase_table_2.* FROM hbase_table_2 WHERE hbase_table_2.key < 120) Y ON (x.key = Y.key) ORDER BY key,value POSTHOOK: type: QUERY POSTHOOK: Input: default@hbase_table_1 POSTHOOK: Input: default@hbase_table_2 #### A masked pattern was here #### 104 val_104 114 val_114 116 val_116 118 val_118 PREHOOK: query: DROP TABLE empty_hbase_table PREHOOK: type: DROPTABLE POSTHOOK: query: DROP TABLE empty_hbase_table POSTHOOK: type: DROPTABLE PREHOOK: query: CREATE TABLE empty_hbase_table(key int, value string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = "cf:string") PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@empty_hbase_table POSTHOOK: query: CREATE TABLE empty_hbase_table(key int, value string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = "cf:string") POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@empty_hbase_table PREHOOK: query: DROP TABLE empty_normal_table PREHOOK: type: DROPTABLE POSTHOOK: query: DROP TABLE empty_normal_table POSTHOOK: type: DROPTABLE PREHOOK: query: CREATE TABLE empty_normal_table(key int, value string) PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@empty_normal_table POSTHOOK: query: CREATE TABLE empty_normal_table(key int, value string) POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@empty_normal_table PREHOOK: query: select * from (select count(1) as c from empty_normal_table union all select count(1) as c from empty_hbase_table) x order by c PREHOOK: type: QUERY PREHOOK: Input: default@empty_hbase_table PREHOOK: Input: default@empty_normal_table #### A masked pattern was here #### POSTHOOK: query: select * from (select count(1) as c from empty_normal_table union all select count(1) as c from empty_hbase_table) x order by c POSTHOOK: type: QUERY POSTHOOK: Input: default@empty_hbase_table POSTHOOK: Input: default@empty_normal_table #### A masked pattern was here #### 0 0 PREHOOK: query: select * from (select count(1) c from empty_normal_table union all select count(1) as c from hbase_table_1) x order by c PREHOOK: type: QUERY PREHOOK: Input: default@empty_normal_table PREHOOK: Input: default@hbase_table_1 #### A masked pattern was here #### POSTHOOK: query: select * from (select count(1) c from empty_normal_table union all select count(1) as c from hbase_table_1) x order by c POSTHOOK: type: QUERY POSTHOOK: Input: default@empty_normal_table POSTHOOK: Input: default@hbase_table_1 #### A masked pattern was here #### 0 155 PREHOOK: query: select * from (select count(1) c from src union all select count(1) as c from empty_hbase_table) x order by c PREHOOK: type: QUERY PREHOOK: Input: default@empty_hbase_table PREHOOK: Input: default@src #### A masked pattern was here #### POSTHOOK: query: select * from (select count(1) c from src union all select count(1) as c from empty_hbase_table) x order by c POSTHOOK: type: QUERY POSTHOOK: Input: default@empty_hbase_table POSTHOOK: Input: default@src #### A masked pattern was here #### 0 500 PREHOOK: query: select * from (select count(1) c from src union all select count(1) as c from hbase_table_1) x order by c PREHOOK: type: QUERY PREHOOK: Input: default@hbase_table_1 PREHOOK: Input: default@src #### A masked pattern was here #### POSTHOOK: query: select * from (select count(1) c from src union all select count(1) as c from hbase_table_1) x order by c POSTHOOK: type: QUERY POSTHOOK: Input: default@hbase_table_1 POSTHOOK: Input: default@src #### A masked pattern was here #### 155 500 PREHOOK: query: CREATE TABLE hbase_table_3(key int, value string, count int) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ( "hbase.columns.mapping" = "cf:val,cf2:count" ) PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@hbase_table_3 POSTHOOK: query: CREATE TABLE hbase_table_3(key int, value string, count int) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ( "hbase.columns.mapping" = "cf:val,cf2:count" ) POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@hbase_table_3 PREHOOK: query: EXPLAIN INSERT OVERWRITE TABLE hbase_table_3 SELECT x.key, x.value, Y.count FROM (SELECT hbase_table_1.* FROM hbase_table_1) x JOIN (SELECT src.key, count(src.key) as count FROM src GROUP BY src.key) Y ON (x.key = Y.key) PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN INSERT OVERWRITE TABLE hbase_table_3 SELECT x.key, x.value, Y.count FROM (SELECT hbase_table_1.* FROM hbase_table_1) x JOIN (SELECT src.key, count(src.key) as count FROM src GROUP BY src.key) Y ON (x.key = Y.key) POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 depends on stages: Stage-1 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: src Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: UDFToDouble(key) is not null (type: boolean) Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE Group By Operator aggregations: count(key) keys: key (type: string) mode: hash outputColumnNames: _col0, _col1 Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator key expressions: _col0 (type: string) sort order: + Map-reduce partition columns: _col0 (type: string) Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE value expressions: _col1 (type: bigint) Reduce Operator Tree: Group By Operator aggregations: count(VALUE._col0) keys: KEY._col0 (type: string) mode: mergepartial outputColumnNames: _col0, _col1 Statistics: Num rows: 125 Data size: 1328 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe Stage: Stage-0 Map Reduce Map Operator Tree: TableScan alias: hbase_table_1 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Filter Operator predicate: UDFToDouble(key) is not null (type: boolean) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Select Operator expressions: key (type: int), value (type: string) outputColumnNames: _col0, _col1 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Reduce Output Operator key expressions: UDFToDouble(_col0) (type: double) sort order: + Map-reduce partition columns: UDFToDouble(_col0) (type: double) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: _col0 (type: int), _col1 (type: string) TableScan Reduce Output Operator key expressions: UDFToDouble(_col0) (type: double) sort order: + Map-reduce partition columns: UDFToDouble(_col0) (type: double) Statistics: Num rows: 125 Data size: 1328 Basic stats: COMPLETE Column stats: NONE value expressions: _col1 (type: bigint) Reduce Operator Tree: Join Operator condition map: Inner Join 0 to 1 keys: 0 UDFToDouble(_col0) (type: double) 1 UDFToDouble(_col0) (type: double) outputColumnNames: _col0, _col1, _col3 Statistics: Num rows: 137 Data size: 1460 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col0 (type: int), _col1 (type: string), UDFToInteger(_col3) (type: int) outputColumnNames: _col0, _col1, _col2 Statistics: Num rows: 137 Data size: 1460 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 137 Data size: 1460 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat output format: org.apache.hadoop.hive.hbase.HiveHBaseTableOutputFormat serde: org.apache.hadoop.hive.hbase.HBaseSerDe name: default.hbase_table_3 PREHOOK: query: INSERT OVERWRITE TABLE hbase_table_3 SELECT x.key, x.value, Y.count FROM (SELECT hbase_table_1.* FROM hbase_table_1) x JOIN (SELECT src.key, count(src.key) as count FROM src GROUP BY src.key) Y ON (x.key = Y.key) PREHOOK: type: QUERY PREHOOK: Input: default@hbase_table_1 PREHOOK: Input: default@src PREHOOK: Output: default@hbase_table_3 POSTHOOK: query: INSERT OVERWRITE TABLE hbase_table_3 SELECT x.key, x.value, Y.count FROM (SELECT hbase_table_1.* FROM hbase_table_1) x JOIN (SELECT src.key, count(src.key) as count FROM src GROUP BY src.key) Y ON (x.key = Y.key) POSTHOOK: type: QUERY POSTHOOK: Input: default@hbase_table_1 POSTHOOK: Input: default@src POSTHOOK: Output: default@hbase_table_3 PREHOOK: query: select count(1) from hbase_table_3 PREHOOK: type: QUERY PREHOOK: Input: default@hbase_table_3 #### A masked pattern was here #### POSTHOOK: query: select count(1) from hbase_table_3 POSTHOOK: type: QUERY POSTHOOK: Input: default@hbase_table_3 #### A masked pattern was here #### 155 PREHOOK: query: select * from hbase_table_3 order by key, value limit 5 PREHOOK: type: QUERY PREHOOK: Input: default@hbase_table_3 #### A masked pattern was here #### POSTHOOK: query: select * from hbase_table_3 order by key, value limit 5 POSTHOOK: type: QUERY POSTHOOK: Input: default@hbase_table_3 #### A masked pattern was here #### 0 val_0 3 2 val_2 1 4 val_4 1 8 val_8 1 10 val_10 1 PREHOOK: query: select key, count from hbase_table_3 order by key, count desc limit 5 PREHOOK: type: QUERY PREHOOK: Input: default@hbase_table_3 #### A masked pattern was here #### POSTHOOK: query: select key, count from hbase_table_3 order by key, count desc limit 5 POSTHOOK: type: QUERY POSTHOOK: Input: default@hbase_table_3 #### A masked pattern was here #### 0 3 2 1 4 1 8 1 10 1 PREHOOK: query: DROP TABLE hbase_table_4 PREHOOK: type: DROPTABLE POSTHOOK: query: DROP TABLE hbase_table_4 POSTHOOK: type: DROPTABLE PREHOOK: query: CREATE TABLE hbase_table_4(key int, value1 string, value2 int, value3 int) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ( "hbase.columns.mapping" = "a:b,a:c,d:e" ) PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@hbase_table_4 POSTHOOK: query: CREATE TABLE hbase_table_4(key int, value1 string, value2 int, value3 int) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ( "hbase.columns.mapping" = "a:b,a:c,d:e" ) POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@hbase_table_4 PREHOOK: query: INSERT OVERWRITE TABLE hbase_table_4 SELECT key, value, key+1, key+2 FROM src WHERE key=98 OR key=100 PREHOOK: type: QUERY PREHOOK: Input: default@src PREHOOK: Output: default@hbase_table_4 POSTHOOK: query: INSERT OVERWRITE TABLE hbase_table_4 SELECT key, value, key+1, key+2 FROM src WHERE key=98 OR key=100 POSTHOOK: type: QUERY POSTHOOK: Input: default@src POSTHOOK: Output: default@hbase_table_4 PREHOOK: query: SELECT * FROM hbase_table_4 ORDER BY key PREHOOK: type: QUERY PREHOOK: Input: default@hbase_table_4 #### A masked pattern was here #### POSTHOOK: query: SELECT * FROM hbase_table_4 ORDER BY key POSTHOOK: type: QUERY POSTHOOK: Input: default@hbase_table_4 #### A masked pattern was here #### 98 val_98 99 100 100 val_100 101 102 PREHOOK: query: DROP TABLE hbase_table_5 PREHOOK: type: DROPTABLE POSTHOOK: query: DROP TABLE hbase_table_5 POSTHOOK: type: DROPTABLE PREHOOK: query: CREATE EXTERNAL TABLE hbase_table_5(key int, value map) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = "a:") TBLPROPERTIES ("hbase.table.name" = "hbase_table_4") PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@hbase_table_5 POSTHOOK: query: CREATE EXTERNAL TABLE hbase_table_5(key int, value map) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = "a:") TBLPROPERTIES ("hbase.table.name" = "hbase_table_4") POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@hbase_table_5 PREHOOK: query: SELECT * FROM hbase_table_5 ORDER BY key PREHOOK: type: QUERY PREHOOK: Input: default@hbase_table_5 #### A masked pattern was here #### POSTHOOK: query: SELECT * FROM hbase_table_5 ORDER BY key POSTHOOK: type: QUERY POSTHOOK: Input: default@hbase_table_5 #### A masked pattern was here #### 98 {"b":"val_98","c":"99"} 100 {"b":"val_100","c":"101"} PREHOOK: query: DROP TABLE hbase_table_6 PREHOOK: type: DROPTABLE POSTHOOK: query: DROP TABLE hbase_table_6 POSTHOOK: type: DROPTABLE PREHOOK: query: CREATE TABLE hbase_table_6(key int, value map) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ( "hbase.columns.mapping" = ":key,cf:" ) PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@hbase_table_6 POSTHOOK: query: CREATE TABLE hbase_table_6(key int, value map) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ( "hbase.columns.mapping" = ":key,cf:" ) POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@hbase_table_6 PREHOOK: query: INSERT OVERWRITE TABLE hbase_table_6 SELECT key, map(value, key) FROM src WHERE key=98 OR key=100 PREHOOK: type: QUERY PREHOOK: Input: default@src PREHOOK: Output: default@hbase_table_6 POSTHOOK: query: INSERT OVERWRITE TABLE hbase_table_6 SELECT key, map(value, key) FROM src WHERE key=98 OR key=100 POSTHOOK: type: QUERY POSTHOOK: Input: default@src POSTHOOK: Output: default@hbase_table_6 PREHOOK: query: SELECT * FROM hbase_table_6 ORDER BY key PREHOOK: type: QUERY PREHOOK: Input: default@hbase_table_6 #### A masked pattern was here #### POSTHOOK: query: SELECT * FROM hbase_table_6 ORDER BY key POSTHOOK: type: QUERY POSTHOOK: Input: default@hbase_table_6 #### A masked pattern was here #### 98 {"val_98":"98"} 100 {"val_100":"100"} PREHOOK: query: DROP TABLE hbase_table_7 PREHOOK: type: DROPTABLE POSTHOOK: query: DROP TABLE hbase_table_7 POSTHOOK: type: DROPTABLE PREHOOK: query: CREATE TABLE hbase_table_7(value map, key int) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ( "hbase.columns.mapping" = "cf:,:key" ) PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@hbase_table_7 POSTHOOK: query: CREATE TABLE hbase_table_7(value map, key int) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ( "hbase.columns.mapping" = "cf:,:key" ) POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@hbase_table_7 PREHOOK: query: INSERT OVERWRITE TABLE hbase_table_7 SELECT map(value, key, upper(value), key+1), key FROM src WHERE key=98 OR key=100 PREHOOK: type: QUERY PREHOOK: Input: default@src PREHOOK: Output: default@hbase_table_7 POSTHOOK: query: INSERT OVERWRITE TABLE hbase_table_7 SELECT map(value, key, upper(value), key+1), key FROM src WHERE key=98 OR key=100 POSTHOOK: type: QUERY POSTHOOK: Input: default@src POSTHOOK: Output: default@hbase_table_7 PREHOOK: query: SELECT * FROM hbase_table_7 ORDER BY key PREHOOK: type: QUERY PREHOOK: Input: default@hbase_table_7 #### A masked pattern was here #### POSTHOOK: query: SELECT * FROM hbase_table_7 ORDER BY key POSTHOOK: type: QUERY POSTHOOK: Input: default@hbase_table_7 #### A masked pattern was here #### {"VAL_98":"99.0","val_98":"98"} 98 {"VAL_100":"101.0","val_100":"100"} 100 PREHOOK: query: DROP TABLE hbase_table_8 PREHOOK: type: DROPTABLE POSTHOOK: query: DROP TABLE hbase_table_8 POSTHOOK: type: DROPTABLE PREHOOK: query: CREATE TABLE hbase_table_8(key int, value1 string, value2 int, value3 int) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ( "hbase.columns.mapping" = "a:b,a:c,d:e" ) PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@hbase_table_8 POSTHOOK: query: CREATE TABLE hbase_table_8(key int, value1 string, value2 int, value3 int) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ( "hbase.columns.mapping" = "a:b,a:c,d:e" ) POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@hbase_table_8 PREHOOK: query: INSERT OVERWRITE TABLE hbase_table_8 SELECT key, value, key+1, key+2 FROM src WHERE key=98 OR key=100 PREHOOK: type: QUERY PREHOOK: Input: default@src PREHOOK: Output: default@hbase_table_8 POSTHOOK: query: INSERT OVERWRITE TABLE hbase_table_8 SELECT key, value, key+1, key+2 FROM src WHERE key=98 OR key=100 POSTHOOK: type: QUERY POSTHOOK: Input: default@src POSTHOOK: Output: default@hbase_table_8 PREHOOK: query: SELECT * FROM hbase_table_8 ORDER BY key PREHOOK: type: QUERY PREHOOK: Input: default@hbase_table_8 #### A masked pattern was here #### POSTHOOK: query: SELECT * FROM hbase_table_8 ORDER BY key POSTHOOK: type: QUERY POSTHOOK: Input: default@hbase_table_8 #### A masked pattern was here #### 98 val_98 99 100 100 val_100 101 102 PREHOOK: query: DROP TABLE hbase_table_1 PREHOOK: type: DROPTABLE PREHOOK: Input: default@hbase_table_1 PREHOOK: Output: default@hbase_table_1 POSTHOOK: query: DROP TABLE hbase_table_1 POSTHOOK: type: DROPTABLE POSTHOOK: Input: default@hbase_table_1 POSTHOOK: Output: default@hbase_table_1 PREHOOK: query: DROP TABLE hbase_table_2 PREHOOK: type: DROPTABLE PREHOOK: Input: default@hbase_table_2 PREHOOK: Output: default@hbase_table_2 POSTHOOK: query: DROP TABLE hbase_table_2 POSTHOOK: type: DROPTABLE POSTHOOK: Input: default@hbase_table_2 POSTHOOK: Output: default@hbase_table_2 PREHOOK: query: DROP TABLE hbase_table_3 PREHOOK: type: DROPTABLE PREHOOK: Input: default@hbase_table_3 PREHOOK: Output: default@hbase_table_3 POSTHOOK: query: DROP TABLE hbase_table_3 POSTHOOK: type: DROPTABLE POSTHOOK: Input: default@hbase_table_3 POSTHOOK: Output: default@hbase_table_3 PREHOOK: query: DROP TABLE hbase_table_4 PREHOOK: type: DROPTABLE PREHOOK: Input: default@hbase_table_4 PREHOOK: Output: default@hbase_table_4 POSTHOOK: query: DROP TABLE hbase_table_4 POSTHOOK: type: DROPTABLE POSTHOOK: Input: default@hbase_table_4 POSTHOOK: Output: default@hbase_table_4 PREHOOK: query: DROP TABLE hbase_table_5 PREHOOK: type: DROPTABLE PREHOOK: Input: default@hbase_table_5 PREHOOK: Output: default@hbase_table_5 POSTHOOK: query: DROP TABLE hbase_table_5 POSTHOOK: type: DROPTABLE POSTHOOK: Input: default@hbase_table_5 POSTHOOK: Output: default@hbase_table_5 PREHOOK: query: DROP TABLE hbase_table_6 PREHOOK: type: DROPTABLE PREHOOK: Input: default@hbase_table_6 PREHOOK: Output: default@hbase_table_6 POSTHOOK: query: DROP TABLE hbase_table_6 POSTHOOK: type: DROPTABLE POSTHOOK: Input: default@hbase_table_6 POSTHOOK: Output: default@hbase_table_6 PREHOOK: query: DROP TABLE hbase_table_7 PREHOOK: type: DROPTABLE PREHOOK: Input: default@hbase_table_7 PREHOOK: Output: default@hbase_table_7 POSTHOOK: query: DROP TABLE hbase_table_7 POSTHOOK: type: DROPTABLE POSTHOOK: Input: default@hbase_table_7 POSTHOOK: Output: default@hbase_table_7 PREHOOK: query: DROP TABLE hbase_table_8 PREHOOK: type: DROPTABLE PREHOOK: Input: default@hbase_table_8 PREHOOK: Output: default@hbase_table_8 POSTHOOK: query: DROP TABLE hbase_table_8 POSTHOOK: type: DROPTABLE POSTHOOK: Input: default@hbase_table_8 POSTHOOK: Output: default@hbase_table_8 PREHOOK: query: DROP TABLE empty_hbase_table PREHOOK: type: DROPTABLE PREHOOK: Input: default@empty_hbase_table PREHOOK: Output: default@empty_hbase_table POSTHOOK: query: DROP TABLE empty_hbase_table POSTHOOK: type: DROPTABLE POSTHOOK: Input: default@empty_hbase_table POSTHOOK: Output: default@empty_hbase_table PREHOOK: query: DROP TABLE empty_normal_table PREHOOK: type: DROPTABLE PREHOOK: Input: default@empty_normal_table PREHOOK: Output: default@empty_normal_table POSTHOOK: query: DROP TABLE empty_normal_table POSTHOOK: type: DROPTABLE POSTHOOK: Input: default@empty_normal_table POSTHOOK: Output: default@empty_normal_table