PREHOOK: query: CREATE TABLE dest1(`location` INT, `type` STRING) PARTITIONED BY(`table` STRING) STORED AS TEXTFILE PREHOOK: type: CREATETABLE POSTHOOK: query: CREATE TABLE dest1(`location` INT, `type` STRING) PARTITIONED BY(`table` STRING) STORED AS TEXTFILE POSTHOOK: type: CREATETABLE POSTHOOK: Output: default@dest1 PREHOOK: query: EXPLAIN FROM src INSERT OVERWRITE TABLE dest1 PARTITION(`table`='2008-04-08') SELECT src.key as `partition`, src.value as `from` WHERE src.key >= 200 and src.key < 300 PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN FROM src INSERT OVERWRITE TABLE dest1 PARTITION(`table`='2008-04-08') SELECT src.key as `partition`, src.value as `from` WHERE src.key >= 200 and src.key < 300 POSTHOOK: type: QUERY ABSTRACT SYNTAX TREE: (TOK_QUERY (TOK_FROM (TOK_TABREF src)) (TOK_INSERT (TOK_DESTINATION (TOK_TAB dest1 (TOK_PARTSPEC (TOK_PARTVAL `table` '2008-04-08')))) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL src) key) `partition`) (TOK_SELEXPR (. (TOK_TABLE_OR_COL src) value) `from`)) (TOK_WHERE (and (>= (. (TOK_TABLE_OR_COL src) key) 200) (< (. (TOK_TABLE_OR_COL src) key) 300))))) STAGE DEPENDENCIES: Stage-1 is a root stage Stage-4 depends on stages: Stage-1 , consists of Stage-3, Stage-2 Stage-3 Stage-0 depends on stages: Stage-3, Stage-2 Stage-2 STAGE PLANS: Stage: Stage-1 Map Reduce Alias -> Map Operator Tree: src TableScan alias: src Filter Operator predicate: expr: ((key >= 200) and (key < 300)) type: boolean Filter Operator predicate: expr: ((key >= 200) and (key < 300)) type: boolean Select Operator expressions: expr: key type: string expr: value type: string outputColumnNames: _col0, _col1 Select Operator expressions: expr: UDFToInteger(_col0) type: int expr: _col1 type: string outputColumnNames: _col0, _col1 File Output Operator compressed: false GlobalTableId: 1 table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: dest1 Stage: Stage-4 Conditional Operator Stage: Stage-3 Move Operator files: hdfs directory: true destination: file:/data/users/nzhang/reviews/0.6/branch-0.6/build/ql/scratchdir/hive_2010-08-23_22-18-30_855_5426915795586740813/10000 Stage: Stage-0 Move Operator tables: partition: table 2008-04-08 replace: true table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: dest1 Stage: Stage-2 Map Reduce Alias -> Map Operator Tree: file:/data/users/nzhang/reviews/0.6/branch-0.6/build/ql/scratchdir/hive_2010-08-23_22-18-30_855_5426915795586740813/10002 Reduce Output Operator sort order: Map-reduce partition columns: expr: rand() type: double tag: -1 value expressions: expr: location type: int expr: type type: string Reduce Operator Tree: Extract File Output Operator compressed: false GlobalTableId: 0 table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe name: dest1 PREHOOK: query: EXPLAIN SELECT `int`.`location`, `int`.`type`, `int`.`table` FROM dest1 `int` WHERE `int`.`table` = '2008-04-08' PREHOOK: type: QUERY POSTHOOK: query: EXPLAIN SELECT `int`.`location`, `int`.`type`, `int`.`table` FROM dest1 `int` WHERE `int`.`table` = '2008-04-08' POSTHOOK: type: QUERY ABSTRACT SYNTAX TREE: (TOK_QUERY (TOK_FROM (TOK_TABREF dest1 `int`)) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL `int`) `location`)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL `int`) `type`)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL `int`) `table`))) (TOK_WHERE (= (. (TOK_TABLE_OR_COL `int`) `table`) '2008-04-08')))) STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 is a root stage STAGE PLANS: Stage: Stage-1 Map Reduce Alias -> Map Operator Tree: int TableScan alias: int Filter Operator predicate: expr: (table = '2008-04-08') type: boolean Filter Operator predicate: expr: (table = '2008-04-08') type: boolean Select Operator expressions: expr: location type: int expr: type type: string expr: table type: string outputColumnNames: _col0, _col1, _col2 File Output Operator compressed: false GlobalTableId: 0 table: input format: org.apache.hadoop.mapred.TextInputFormat output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat Stage: Stage-0 Fetch Operator limit: -1 PREHOOK: query: FROM src INSERT OVERWRITE TABLE dest1 PARTITION(`table`='2008-04-08') SELECT src.key as `partition`, src.value as `from` WHERE src.key >= 200 and src.key < 300 PREHOOK: type: QUERY PREHOOK: Input: default@src PREHOOK: Output: default@dest1@table=2008-04-08 POSTHOOK: query: FROM src INSERT OVERWRITE TABLE dest1 PARTITION(`table`='2008-04-08') SELECT src.key as `partition`, src.value as `from` WHERE src.key >= 200 and src.key < 300 POSTHOOK: type: QUERY POSTHOOK: Input: default@src POSTHOOK: Output: default@dest1@table=2008-04-08 POSTHOOK: Lineage: dest1 PARTITION(table=2008-04-08).location EXPRESSION [(src)src.FieldSchema(name:key, type:string, comment:default), ] POSTHOOK: Lineage: dest1 PARTITION(table=2008-04-08).type SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ] PREHOOK: query: SELECT `int`.`location`, `int`.`type`, `int`.`table` FROM dest1 `int` WHERE `int`.`table` = '2008-04-08' PREHOOK: type: QUERY PREHOOK: Input: default@dest1@table=2008-04-08 PREHOOK: Output: file:/tmp/nzhang/hive_2010-08-23_22-18-34_233_8398142303940917470/10000 POSTHOOK: query: SELECT `int`.`location`, `int`.`type`, `int`.`table` FROM dest1 `int` WHERE `int`.`table` = '2008-04-08' POSTHOOK: type: QUERY POSTHOOK: Input: default@dest1@table=2008-04-08 POSTHOOK: Output: file:/tmp/nzhang/hive_2010-08-23_22-18-34_233_8398142303940917470/10000 POSTHOOK: Lineage: dest1 PARTITION(table=2008-04-08).location EXPRESSION [(src)src.FieldSchema(name:key, type:string, comment:default), ] POSTHOOK: Lineage: dest1 PARTITION(table=2008-04-08).type SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ] 238 val_238 2008-04-08 255 val_255 2008-04-08 278 val_278 2008-04-08 265 val_265 2008-04-08 273 val_273 2008-04-08 224 val_224 2008-04-08 213 val_213 2008-04-08 281 val_281 2008-04-08 277 val_277 2008-04-08 209 val_209 2008-04-08 252 val_252 2008-04-08 292 val_292 2008-04-08 219 val_219 2008-04-08 287 val_287 2008-04-08 237 val_237 2008-04-08 207 val_207 2008-04-08 208 val_208 2008-04-08 247 val_247 2008-04-08 266 val_266 2008-04-08 203 val_203 2008-04-08 205 val_205 2008-04-08 221 val_221 2008-04-08 280 val_280 2008-04-08 277 val_277 2008-04-08 208 val_208 2008-04-08 286 val_286 2008-04-08 239 val_239 2008-04-08 213 val_213 2008-04-08 216 val_216 2008-04-08 278 val_278 2008-04-08 289 val_289 2008-04-08 221 val_221 2008-04-08 275 val_275 2008-04-08 241 val_241 2008-04-08 284 val_284 2008-04-08 230 val_230 2008-04-08 260 val_260 2008-04-08 272 val_272 2008-04-08 217 val_217 2008-04-08 230 val_230 2008-04-08 208 val_208 2008-04-08 298 val_298 2008-04-08 230 val_230 2008-04-08 205 val_205 2008-04-08 288 val_288 2008-04-08 282 val_282 2008-04-08 282 val_282 2008-04-08 238 val_238 2008-04-08 277 val_277 2008-04-08 273 val_273 2008-04-08 224 val_224 2008-04-08 242 val_242 2008-04-08 272 val_272 2008-04-08 242 val_242 2008-04-08 226 val_226 2008-04-08 229 val_229 2008-04-08 233 val_233 2008-04-08 223 val_223 2008-04-08 218 val_218 2008-04-08 228 val_228 2008-04-08 209 val_209 2008-04-08 230 val_230 2008-04-08 296 val_296 2008-04-08 216 val_216 2008-04-08 274 val_274 2008-04-08 219 val_219 2008-04-08 239 val_239 2008-04-08 223 val_223 2008-04-08 256 val_256 2008-04-08 263 val_263 2008-04-08 288 val_288 2008-04-08 244 val_244 2008-04-08 202 val_202 2008-04-08 229 val_229 2008-04-08 280 val_280 2008-04-08 283 val_283 2008-04-08 235 val_235 2008-04-08 257 val_257 2008-04-08 258 val_258 2008-04-08 203 val_203 2008-04-08 262 val_262 2008-04-08 201 val_201 2008-04-08 217 val_217 2008-04-08 298 val_298 2008-04-08 291 val_291 2008-04-08 255 val_255 2008-04-08 200 val_200 2008-04-08 237 val_237 2008-04-08 248 val_248 2008-04-08 277 val_277 2008-04-08 230 val_230 2008-04-08 207 val_207 2008-04-08 249 val_249 2008-04-08 265 val_265 2008-04-08 214 val_214 2008-04-08 233 val_233 2008-04-08 256 val_256 2008-04-08 298 val_298 2008-04-08 285 val_285 2008-04-08 273 val_273 2008-04-08 281 val_281 2008-04-08 222 val_222 2008-04-08 200 val_200 2008-04-08