PREHOOK: query: -- SORT_QUERY_RESULTS CREATE TABLE orc_pred(t tinyint, si smallint, i int, b bigint, f float, d double, bo boolean, s string, ts timestamp, dec decimal(4,2), bin binary) STORED AS ORC PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@orc_pred POSTHOOK: query: -- SORT_QUERY_RESULTS CREATE TABLE orc_pred(t tinyint, si smallint, i int, b bigint, f float, d double, bo boolean, s string, ts timestamp, dec decimal(4,2), bin binary) STORED AS ORC POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@orc_pred PREHOOK: query: ALTER TABLE orc_pred SET SERDEPROPERTIES ('orc.row.index.stride' = '1000') PREHOOK: type: ALTERTABLE_SERDEPROPERTIES PREHOOK: Input: default@orc_pred PREHOOK: Output: default@orc_pred POSTHOOK: query: ALTER TABLE orc_pred SET SERDEPROPERTIES ('orc.row.index.stride' = '1000') POSTHOOK: type: ALTERTABLE_SERDEPROPERTIES POSTHOOK: Input: default@orc_pred POSTHOOK: Output: default@orc_pred PREHOOK: query: CREATE TABLE staging(t tinyint, si smallint, i int, b bigint, f float, d double, bo boolean, s string, ts timestamp, dec decimal(4,2), bin binary) ROW FORMAT DELIMITED FIELDS TERMINATED BY '|' STORED AS TEXTFILE PREHOOK: type: CREATETABLE PREHOOK: Output: database:default PREHOOK: Output: default@staging POSTHOOK: query: CREATE TABLE staging(t tinyint, si smallint, i int, b bigint, f float, d double, bo boolean, s string, ts timestamp, dec decimal(4,2), bin binary) ROW FORMAT DELIMITED FIELDS TERMINATED BY '|' STORED AS TEXTFILE POSTHOOK: type: CREATETABLE POSTHOOK: Output: database:default POSTHOOK: Output: default@staging PREHOOK: query: LOAD DATA LOCAL INPATH '../../data/files/over1k' OVERWRITE INTO TABLE staging PREHOOK: type: LOAD #### A masked pattern was here #### PREHOOK: Output: default@staging POSTHOOK: query: LOAD DATA LOCAL INPATH '../../data/files/over1k' OVERWRITE INTO TABLE staging POSTHOOK: type: LOAD #### A masked pattern was here #### POSTHOOK: Output: default@staging PREHOOK: query: INSERT INTO TABLE orc_pred select * from staging PREHOOK: type: QUERY PREHOOK: Input: default@staging PREHOOK: Output: default@orc_pred POSTHOOK: query: INSERT INTO TABLE orc_pred select * from staging POSTHOOK: type: QUERY POSTHOOK: Input: default@staging POSTHOOK: Output: default@orc_pred POSTHOOK: Lineage: orc_pred.b SIMPLE [(staging)staging.FieldSchema(name:b, type:bigint, comment:null), ] POSTHOOK: Lineage: orc_pred.bin SIMPLE [(staging)staging.FieldSchema(name:bin, type:binary, comment:null), ] POSTHOOK: Lineage: orc_pred.bo SIMPLE [(staging)staging.FieldSchema(name:bo, type:boolean, comment:null), ] POSTHOOK: Lineage: orc_pred.d SIMPLE [(staging)staging.FieldSchema(name:d, type:double, comment:null), ] POSTHOOK: Lineage: orc_pred.dec SIMPLE [(staging)staging.FieldSchema(name:dec, type:decimal(4,2), comment:null), ] POSTHOOK: Lineage: orc_pred.f SIMPLE [(staging)staging.FieldSchema(name:f, type:float, comment:null), ] POSTHOOK: Lineage: orc_pred.i SIMPLE [(staging)staging.FieldSchema(name:i, type:int, comment:null), ] POSTHOOK: Lineage: orc_pred.s SIMPLE [(staging)staging.FieldSchema(name:s, type:string, comment:null), ] POSTHOOK: Lineage: orc_pred.si SIMPLE [(staging)staging.FieldSchema(name:si, type:smallint, comment:null), ] POSTHOOK: Lineage: orc_pred.t SIMPLE [(staging)staging.FieldSchema(name:t, type:tinyint, comment:null), ] POSTHOOK: Lineage: orc_pred.ts SIMPLE [(staging)staging.FieldSchema(name:ts, type:timestamp, comment:null), ] PREHOOK: query: -- no predicate case. the explain plan should not have filter expression in table scan operator SELECT SUM(HASH(t)) FROM orc_pred PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: -- no predicate case. the explain plan should not have filter expression in table scan operator SELECT SUM(HASH(t)) FROM orc_pred POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### 62430 PREHOOK: query: SELECT SUM(HASH(t)) FROM orc_pred PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: SELECT SUM(HASH(t)) FROM orc_pred POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### 62430 PREHOOK: query: EXPLAIN SELECT SUM(HASH(t)) FROM orc_pred PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT SUM(HASH(t)) FROM orc_pred POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 depends on stages: Stage-1 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: orc_pred Statistics: Num rows: 1049 Data size: 311170 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: hash(t) (type: int) outputColumnNames: _col0 Statistics: Num rows: 1049 Data size: 311170 Basic stats: COMPLETE Column stats: NONE Group By Operator aggregations: sum(_col0) mode: hash outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE value expressions: _col0 (type: bigint) Reduce Operator Tree: Group By Operator aggregations: sum(VALUE._col0) mode: mergepartial outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col0 (type: bigint) outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Stage: Stage-0 Fetch Operator limit: -1 Processor Tree: ListSink PREHOOK: query: EXPLAIN SELECT SUM(HASH(t)) FROM orc_pred PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT SUM(HASH(t)) FROM orc_pred POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 depends on stages: Stage-1 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: orc_pred Statistics: Num rows: 1049 Data size: 311170 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: hash(t) (type: int) outputColumnNames: _col0 Statistics: Num rows: 1049 Data size: 311170 Basic stats: COMPLETE Column stats: NONE Group By Operator aggregations: sum(_col0) mode: hash outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE value expressions: _col0 (type: bigint) Reduce Operator Tree: Group By Operator aggregations: sum(VALUE._col0) mode: mergepartial outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col0 (type: bigint) outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Stage: Stage-0 Fetch Operator limit: -1 Processor Tree: ListSink PREHOOK: query: -- all the following queries have predicates which are pushed down to table scan operator if -- hive.optimize.index.filter is set to true. the explain plan should show filter expression -- in table scan operator. SELECT * FROM orc_pred WHERE t<2 limit 1 PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: -- all the following queries have predicates which are pushed down to table scan operator if -- hive.optimize.index.filter is set to true. the explain plan should show filter expression -- in table scan operator. SELECT * FROM orc_pred WHERE t<2 limit 1 POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### -3 467 65575 4294967437 81.64 23.53 true tom hernandez 2013-03-01 09:11:58.703188 32.85 study skills PREHOOK: query: SELECT * FROM orc_pred WHERE t<2 limit 1 PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: SELECT * FROM orc_pred WHERE t<2 limit 1 POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### -3 467 65575 4294967437 81.64 23.53 true tom hernandez 2013-03-01 09:11:58.703188 32.85 study skills PREHOOK: query: SELECT * FROM orc_pred WHERE t>2 limit 1 PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: SELECT * FROM orc_pred WHERE t>2 limit 1 POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### 124 336 65664 4294967435 74.72 42.47 true bob davidson 2013-03-01 09:11:58.703302 45.4 yard duty PREHOOK: query: SELECT * FROM orc_pred WHERE t>2 limit 1 PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: SELECT * FROM orc_pred WHERE t>2 limit 1 POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### 124 336 65664 4294967435 74.72 42.47 true bob davidson 2013-03-01 09:11:58.703302 45.4 yard duty PREHOOK: query: SELECT SUM(HASH(t)) FROM orc_pred WHERE t IS NOT NULL AND t < 0 AND t > -2 PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: SELECT SUM(HASH(t)) FROM orc_pred WHERE t IS NOT NULL AND t < 0 AND t > -2 POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### -8 PREHOOK: query: SELECT SUM(HASH(t)) FROM orc_pred WHERE t IS NOT NULL AND t < 0 AND t > -2 PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: SELECT SUM(HASH(t)) FROM orc_pred WHERE t IS NOT NULL AND t < 0 AND t > -2 POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### -8 PREHOOK: query: EXPLAIN SELECT SUM(HASH(t)) FROM orc_pred WHERE t IS NOT NULL AND t < 0 AND t > -2 PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT SUM(HASH(t)) FROM orc_pred WHERE t IS NOT NULL AND t < 0 AND t > -2 POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 depends on stages: Stage-1 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: orc_pred Statistics: Num rows: 1049 Data size: 311170 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: ((t < 0) and (UDFToInteger(t) > -2)) (type: boolean) Statistics: Num rows: 116 Data size: 34409 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: hash(t) (type: int) outputColumnNames: _col0 Statistics: Num rows: 116 Data size: 34409 Basic stats: COMPLETE Column stats: NONE Group By Operator aggregations: sum(_col0) mode: hash outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE value expressions: _col0 (type: bigint) Reduce Operator Tree: Group By Operator aggregations: sum(VALUE._col0) mode: mergepartial outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col0 (type: bigint) outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Stage: Stage-0 Fetch Operator limit: -1 Processor Tree: ListSink PREHOOK: query: EXPLAIN SELECT SUM(HASH(t)) FROM orc_pred WHERE t IS NOT NULL AND t < 0 AND t > -2 PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT SUM(HASH(t)) FROM orc_pred WHERE t IS NOT NULL AND t < 0 AND t > -2 POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 depends on stages: Stage-1 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: orc_pred filterExpr: ((t < 0) and (UDFToInteger(t) > -2)) (type: boolean) Statistics: Num rows: 1049 Data size: 311170 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: ((t < 0) and (UDFToInteger(t) > -2)) (type: boolean) Statistics: Num rows: 116 Data size: 34409 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: hash(t) (type: int) outputColumnNames: _col0 Statistics: Num rows: 116 Data size: 34409 Basic stats: COMPLETE Column stats: NONE Group By Operator aggregations: sum(_col0) mode: hash outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE value expressions: _col0 (type: bigint) Reduce Operator Tree: Group By Operator aggregations: sum(VALUE._col0) mode: mergepartial outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: _col0 (type: bigint) outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Stage: Stage-0 Fetch Operator limit: -1 Processor Tree: ListSink PREHOOK: query: SELECT t, s FROM orc_pred WHERE t <=> -1 AND s IS NOT NULL AND s LIKE 'bob%' PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: SELECT t, s FROM orc_pred WHERE t <=> -1 AND s IS NOT NULL AND s LIKE 'bob%' POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### -1 bob laertes -1 bob young PREHOOK: query: SELECT t, s FROM orc_pred WHERE t <=> -1 AND s IS NOT NULL AND s LIKE 'bob%' PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: SELECT t, s FROM orc_pred WHERE t <=> -1 AND s IS NOT NULL AND s LIKE 'bob%' POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### -1 bob laertes -1 bob young PREHOOK: query: EXPLAIN SELECT t, s FROM orc_pred WHERE t <=> -1 AND s IS NOT NULL AND s LIKE 'bob%' PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT t, s FROM orc_pred WHERE t <=> -1 AND s IS NOT NULL AND s LIKE 'bob%' POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 depends on stages: Stage-1 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: orc_pred Statistics: Num rows: 1049 Data size: 311170 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: (((t = -1) and s is not null) and (s like 'bob%')) (type: boolean) Statistics: Num rows: 131 Data size: 38859 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: -1 (type: tinyint), s (type: string) outputColumnNames: _col0, _col1 Statistics: Num rows: 131 Data size: 38859 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 131 Data size: 38859 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Stage: Stage-0 Fetch Operator limit: -1 Processor Tree: ListSink PREHOOK: query: EXPLAIN SELECT t, s FROM orc_pred WHERE t <=> -1 AND s IS NOT NULL AND s LIKE 'bob%' PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT t, s FROM orc_pred WHERE t <=> -1 AND s IS NOT NULL AND s LIKE 'bob%' POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 depends on stages: Stage-1 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: orc_pred filterExpr: (((t = -1) and s is not null) and (s like 'bob%')) (type: boolean) Statistics: Num rows: 1049 Data size: 311170 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: (((t = -1) and s is not null) and (s like 'bob%')) (type: boolean) Statistics: Num rows: 131 Data size: 38859 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: -1 (type: tinyint), s (type: string) outputColumnNames: _col0, _col1 Statistics: Num rows: 131 Data size: 38859 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 131 Data size: 38859 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Stage: Stage-0 Fetch Operator limit: -1 Processor Tree: ListSink PREHOOK: query: SELECT t, s FROM orc_pred WHERE s IS NOT NULL AND s LIKE 'bob%' AND t NOT IN (-1,-2,-3) AND t BETWEEN 25 AND 30 SORT BY t,s PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: SELECT t, s FROM orc_pred WHERE s IS NOT NULL AND s LIKE 'bob%' AND t NOT IN (-1,-2,-3) AND t BETWEEN 25 AND 30 SORT BY t,s POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### 26 bob ovid 26 bob quirinius 27 bob ovid PREHOOK: query: SELECT t, s FROM orc_pred WHERE s IS NOT NULL AND s LIKE 'bob%' AND t NOT IN (-1,-2,-3) AND t BETWEEN 25 AND 30 SORT BY t,s PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: SELECT t, s FROM orc_pred WHERE s IS NOT NULL AND s LIKE 'bob%' AND t NOT IN (-1,-2,-3) AND t BETWEEN 25 AND 30 SORT BY t,s POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### 26 bob ovid 26 bob quirinius 27 bob ovid PREHOOK: query: EXPLAIN SELECT t, s FROM orc_pred WHERE s IS NOT NULL AND s LIKE 'bob%' AND t NOT IN (-1,-2,-3) AND t BETWEEN 25 AND 30 SORT BY t,s PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT t, s FROM orc_pred WHERE s IS NOT NULL AND s LIKE 'bob%' AND t NOT IN (-1,-2,-3) AND t BETWEEN 25 AND 30 SORT BY t,s POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 depends on stages: Stage-1 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: orc_pred Statistics: Num rows: 1049 Data size: 311170 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: (((s is not null and (s like 'bob%')) and (not (t) IN (-1, -2, -3))) and t BETWEEN 25 AND 30) (type: boolean) Statistics: Num rows: 65 Data size: 19281 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: t (type: tinyint), s (type: string) outputColumnNames: _col0, _col1 Statistics: Num rows: 65 Data size: 19281 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator key expressions: _col0 (type: tinyint), _col1 (type: string) sort order: ++ Statistics: Num rows: 65 Data size: 19281 Basic stats: COMPLETE Column stats: NONE Reduce Operator Tree: Select Operator expressions: KEY.reducesinkkey0 (type: tinyint), KEY.reducesinkkey1 (type: string) outputColumnNames: _col0, _col1 Statistics: Num rows: 65 Data size: 19281 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 65 Data size: 19281 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Stage: Stage-0 Fetch Operator limit: -1 Processor Tree: ListSink PREHOOK: query: EXPLAIN SELECT t, s FROM orc_pred WHERE s IS NOT NULL AND s LIKE 'bob%' AND t NOT IN (-1,-2,-3) AND t BETWEEN 25 AND 30 SORT BY t,s PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT t, s FROM orc_pred WHERE s IS NOT NULL AND s LIKE 'bob%' AND t NOT IN (-1,-2,-3) AND t BETWEEN 25 AND 30 SORT BY t,s POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 depends on stages: Stage-1 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: orc_pred filterExpr: (((s is not null and (s like 'bob%')) and (not (t) IN (-1, -2, -3))) and t BETWEEN 25 AND 30) (type: boolean) Statistics: Num rows: 1049 Data size: 311170 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: (((s is not null and (s like 'bob%')) and (not (t) IN (-1, -2, -3))) and t BETWEEN 25 AND 30) (type: boolean) Statistics: Num rows: 65 Data size: 19281 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: t (type: tinyint), s (type: string) outputColumnNames: _col0, _col1 Statistics: Num rows: 65 Data size: 19281 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator key expressions: _col0 (type: tinyint), _col1 (type: string) sort order: ++ Statistics: Num rows: 65 Data size: 19281 Basic stats: COMPLETE Column stats: NONE Reduce Operator Tree: Select Operator expressions: KEY.reducesinkkey0 (type: tinyint), KEY.reducesinkkey1 (type: string) outputColumnNames: _col0, _col1 Statistics: Num rows: 65 Data size: 19281 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 65 Data size: 19281 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Stage: Stage-0 Fetch Operator limit: -1 Processor Tree: ListSink PREHOOK: query: SELECT t, si, d, s FROM orc_pred WHERE d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 ORDER BY s DESC LIMIT 3 PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: SELECT t, si, d, s FROM orc_pred WHERE d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 ORDER BY s DESC LIMIT 3 POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### 101 327 11.48 gabriella ellison 15 334 11.12 jessica robinson 7 320 11.54 bob ellison PREHOOK: query: SELECT t, si, d, s FROM orc_pred WHERE d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 ORDER BY s DESC LIMIT 3 PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: SELECT t, si, d, s FROM orc_pred WHERE d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 ORDER BY s DESC LIMIT 3 POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### 101 327 11.48 gabriella ellison 15 334 11.12 jessica robinson 7 320 11.54 bob ellison PREHOOK: query: EXPLAIN SELECT t, si, d, s FROM orc_pred WHERE d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 ORDER BY s DESC LIMIT 3 PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT t, si, d, s FROM orc_pred WHERE d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 ORDER BY s DESC LIMIT 3 POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 depends on stages: Stage-1 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: orc_pred Statistics: Num rows: 1049 Data size: 311170 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: (((((((d >= 10.0) and (d < 12.0)) and t is not null) and (s like '%son')) and (not (s like '%car%'))) and (t > 0)) and si BETWEEN 300 AND 400) (type: boolean) Statistics: Num rows: 2 Data size: 593 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: t (type: tinyint), si (type: smallint), d (type: double), s (type: string) outputColumnNames: _col0, _col1, _col2, _col3 Statistics: Num rows: 2 Data size: 593 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator key expressions: _col3 (type: string) sort order: - Statistics: Num rows: 2 Data size: 593 Basic stats: COMPLETE Column stats: NONE value expressions: _col0 (type: tinyint), _col1 (type: smallint), _col2 (type: double) Reduce Operator Tree: Select Operator expressions: VALUE._col0 (type: tinyint), VALUE._col1 (type: smallint), VALUE._col2 (type: double), KEY.reducesinkkey0 (type: string) outputColumnNames: _col0, _col1, _col2, _col3 Statistics: Num rows: 2 Data size: 593 Basic stats: COMPLETE Column stats: NONE Limit Number of rows: 3 Statistics: Num rows: 2 Data size: 593 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 2 Data size: 593 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Stage: Stage-0 Fetch Operator limit: 3 Processor Tree: ListSink PREHOOK: query: EXPLAIN SELECT t, si, d, s FROM orc_pred WHERE d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 ORDER BY s DESC LIMIT 3 PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT t, si, d, s FROM orc_pred WHERE d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 ORDER BY s DESC LIMIT 3 POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 depends on stages: Stage-1 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: orc_pred filterExpr: (((((((d >= 10.0) and (d < 12.0)) and t is not null) and (s like '%son')) and (not (s like '%car%'))) and (t > 0)) and si BETWEEN 300 AND 400) (type: boolean) Statistics: Num rows: 1049 Data size: 311170 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: (((((((d >= 10.0) and (d < 12.0)) and t is not null) and (s like '%son')) and (not (s like '%car%'))) and (t > 0)) and si BETWEEN 300 AND 400) (type: boolean) Statistics: Num rows: 2 Data size: 593 Basic stats: COMPLETE Column stats: NONE Select Operator expressions: t (type: tinyint), si (type: smallint), d (type: double), s (type: string) outputColumnNames: _col0, _col1, _col2, _col3 Statistics: Num rows: 2 Data size: 593 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator key expressions: _col3 (type: string) sort order: - Statistics: Num rows: 2 Data size: 593 Basic stats: COMPLETE Column stats: NONE value expressions: _col0 (type: tinyint), _col1 (type: smallint), _col2 (type: double) Reduce Operator Tree: Select Operator expressions: VALUE._col0 (type: tinyint), VALUE._col1 (type: smallint), VALUE._col2 (type: double), KEY.reducesinkkey0 (type: string) outputColumnNames: _col0, _col1, _col2, _col3 Statistics: Num rows: 2 Data size: 593 Basic stats: COMPLETE Column stats: NONE Limit Number of rows: 3 Statistics: Num rows: 2 Data size: 593 Basic stats: COMPLETE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 2 Data size: 593 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Stage: Stage-0 Fetch Operator limit: 3 Processor Tree: ListSink PREHOOK: query: SELECT t, si, d, s FROM orc_pred WHERE t > 10 AND t <> 101 AND d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 SORT BY s DESC LIMIT 3 PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: SELECT t, si, d, s FROM orc_pred WHERE t > 10 AND t <> 101 AND d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 SORT BY s DESC LIMIT 3 POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### 15 334 11.12 jessica robinson PREHOOK: query: SELECT t, si, d, s FROM orc_pred WHERE t > 10 AND t <> 101 AND d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 SORT BY s DESC LIMIT 3 PREHOOK: type: QUERY PREHOOK: Input: default@orc_pred #### A masked pattern was here #### POSTHOOK: query: SELECT t, si, d, s FROM orc_pred WHERE t > 10 AND t <> 101 AND d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 SORT BY s DESC LIMIT 3 POSTHOOK: type: QUERY POSTHOOK: Input: default@orc_pred #### A masked pattern was here #### 15 334 11.12 jessica robinson PREHOOK: query: EXPLAIN SELECT t, si, d, s FROM orc_pred WHERE t > 10 AND t <> 101 AND d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 SORT BY s DESC LIMIT 3 PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT t, si, d, s FROM orc_pred WHERE t > 10 AND t <> 101 AND d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 SORT BY s DESC LIMIT 3 POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-1 is a root stage Stage-2 depends on stages: Stage-1 Stage-0 depends on stages: Stage-2 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: orc_pred Statistics: Num rows: 1049 Data size: 311170 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: (((((((((t > 10) and (t <> 101)) and (d >= 10.0)) and (d < 12.0)) and t is not null) and (s like '%son')) and (not (s like '%car%'))) and (t > 0)) and si BETWEEN 300 AND 400) (type: boolean) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Select Operator expressions: t (type: tinyint), si (type: smallint), d (type: double), s (type: string) outputColumnNames: _col0, _col1, _col2, _col3 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Reduce Output Operator key expressions: _col3 (type: string) sort order: - Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: _col0 (type: tinyint), _col1 (type: smallint), _col2 (type: double) Reduce Operator Tree: Select Operator expressions: VALUE._col0 (type: tinyint), VALUE._col1 (type: smallint), VALUE._col2 (type: double), KEY.reducesinkkey0 (type: string) outputColumnNames: _col0, _col1, _col2, _col3 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Limit Number of rows: 3 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE File Output Operator compressed: false table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe Stage: Stage-2 Map Reduce Map Operator Tree: TableScan Reduce Output Operator key expressions: _col3 (type: string) sort order: - Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: _col0 (type: tinyint), _col1 (type: smallint), _col2 (type: double) Reduce Operator Tree: Select Operator expressions: VALUE._col0 (type: tinyint), VALUE._col1 (type: smallint), VALUE._col2 (type: double), KEY.reducesinkkey0 (type: string) outputColumnNames: _col0, _col1, _col2, _col3 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Limit Number of rows: 3 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Stage: Stage-0 Fetch Operator limit: 3 Processor Tree: ListSink PREHOOK: query: EXPLAIN SELECT t, si, d, s FROM orc_pred WHERE t > 10 AND t <> 101 AND d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 SORT BY s DESC LIMIT 3 PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT t, si, d, s FROM orc_pred WHERE t > 10 AND t <> 101 AND d >= ROUND(9.99) AND d < 12 AND t IS NOT NULL AND s LIKE '%son' AND s NOT LIKE '%car%' AND t > 0 AND si BETWEEN 300 AND 400 SORT BY s DESC LIMIT 3 POSTHOOK: type: QUERY STAGE DEPENDENCIES: Stage-1 is a root stage Stage-2 depends on stages: Stage-1 Stage-0 depends on stages: Stage-2 STAGE PLANS: Stage: Stage-1 Map Reduce Map Operator Tree: TableScan alias: orc_pred filterExpr: (((((((((t > 10) and (t <> 101)) and (d >= 10.0)) and (d < 12.0)) and t is not null) and (s like '%son')) and (not (s like '%car%'))) and (t > 0)) and si BETWEEN 300 AND 400) (type: boolean) Statistics: Num rows: 1049 Data size: 311170 Basic stats: COMPLETE Column stats: NONE Filter Operator predicate: (((((((((t > 10) and (t <> 101)) and (d >= 10.0)) and (d < 12.0)) and t is not null) and (s like '%son')) and (not (s like '%car%'))) and (t > 0)) and si BETWEEN 300 AND 400) (type: boolean) Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Select Operator expressions: t (type: tinyint), si (type: smallint), d (type: double), s (type: string) outputColumnNames: _col0, _col1, _col2, _col3 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Reduce Output Operator key expressions: _col3 (type: string) sort order: - Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: _col0 (type: tinyint), _col1 (type: smallint), _col2 (type: double) Reduce Operator Tree: Select Operator expressions: VALUE._col0 (type: tinyint), VALUE._col1 (type: smallint), VALUE._col2 (type: double), KEY.reducesinkkey0 (type: string) outputColumnNames: _col0, _col1, _col2, _col3 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Limit Number of rows: 3 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE File Output Operator compressed: false table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe Stage: Stage-2 Map Reduce Map Operator Tree: TableScan Reduce Output Operator key expressions: _col3 (type: string) sort order: - Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE value expressions: _col0 (type: tinyint), _col1 (type: smallint), _col2 (type: double) Reduce Operator Tree: Select Operator expressions: VALUE._col0 (type: tinyint), VALUE._col1 (type: smallint), VALUE._col2 (type: double), KEY.reducesinkkey0 (type: string) outputColumnNames: _col0, _col1, _col2, _col3 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE Limit Number of rows: 3 Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE File Output Operator compressed: false Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe Stage: Stage-0 Fetch Operator limit: 3 Processor Tree: ListSink