Hive Change Log

Release 0.3.1 - Unreleased

  INCOMPATIBLE CHANGES

  NEW FEATURES

    HIVE-61. Implement "ORDER BY". (Namit Jain via zshao)

    HIVE-376. In strict mode do not allow join without "ON" condition.
    (Namit Jain via zshao)

  IMPROVEMENTS

    HIVE-440. Reducer and Join to print out number of rows processed.
    (Namit Jain via zshao)

  OPTIMIZATIONS

  BUG FIXES

    HIVE-416. Fix backtrack in Hive.g
    (Zheng Shao via namit)

    HIVE-442. Move the data before creating the partition.
    (Prasad Chakka via zshao)

    HIVE-447. Fix tests on hudson. (Ashish Thusoo via zshao)

    HIVE-453. Use FileSystem derived from user supplied path when present
    instead of default. (Joydeep Sen Sarma via prasadc)

    HIVE-816. Cache MetastoreClient. (Dave Lerman via zshao)

Release 0.3.0 - 2009-04-20

  INCOMPATIBLE CHANGES

  NEW FEATURES

    HIVE-337. LazySimpleSerDe to support multi-level nested array, map, struct
    types. (zshao)

    HIVE-313. Add UDF date_add, date_sub, datediff. (zshao)

    HIVE-79. Print number of rows inserted to table(s).
    (Suresh Antony via zshao)

    HIVE-30. Hive Web User Interface. (Edward Capriolo via athusoo)

    HIVE-343. Include py packages for thrift service.
    (Raghotham Murthy via zshao)

    HIVE-299. Include php packages for thrift service.
    (Raghotham Murthy via zshao)

    HIVE-393. Remove unnecessary checks for file type.
    (Zheng Shao via namit)

    HIVE-82. Support for building tarballs and javadocs
    (Ashish Thusoo via rmurthy)

    HIVE-407. Permission issues in test scripts in tarballs.
    (Ashish Thusoo via namit)

    HIVE-61. Implement "ORDER BY". (Namit Jain via zshao)

    HIVE-376. In strict mode do not allow join without "ON" condition.
    (Namit Jain via zshao)

  IMPROVEMENTS

    HIVE-132. Show table and describe results to be read via FetchTask.
    (Raghotham Murthy via zshao)

    HIVE-427. Add missing config parameters in hive-default.xml.
    (Namit Jain via zshao)

    HIVE-440. Reducer and Join to print out number of rows processed.
    (Namit Jain via zshao)

    HIVE-440. Fixed bug in Reducer and Join to print out number of rows processed.
    (Zheng Shao via namit)

  OPTIMIZATIONS

  BUG FIXES

    HIVE-349. Fix TestCliDriver when there are test cases with no tasks.
    (Suresh Antony via zshao)

    HIVE-339. Fix count distinct in 1 map-reduce job with map side
    aggregation. (Namit Jain via zshao)

    HIVE-271. Move test-udfs creation to build-common in order to
    fix broken 0.17 build. (athusoo)

    HIVE-286. Use round(xxx,12) to make sure there is no precision
    matching problem in testCliDriver_udf7. (zshao via johan)

    HIVE-327. Fix row counts printed in hive history to reflect the
    count of rows from the query in the session. (Suresh Anthony via athusoo)

    HIVE-334. Make union3 test output deterministic.
    (Joydeep Sen Sarma via athusoo)

    HIVE-320. Fix intermittent nullpointer exception in count(DISTINCT).
    (Namit Jain via athusoo)

    HIVE-124. Fix empty aggregations to return 1 row instead of
    nothing. (namit)

    HIVE-347. Fix lot of partition scans in strict mode in case of error in
    partition specification error. (namit)

    HIVE-251. Throw an error to the CLI if a user defined script fails in
    TRANSFORM, MAP or REDUCE commands. (athusoo)

    HIVE-317. Fix HiveServer to accept 1 argument for port.
    (Min Zhou via athusoo)

    HIVE-285. Fix to disallow union of different schemas.
    (Raghotham Murthy via namit)

    HIVE-253. Fix to disallow computation of rand() at compilation stage.
    (Raghotham Murthy via namit)

    HIVE-350. Fix wrong order of aggregations in explain plan.
    (namit)

    HIVE-347. undo for Fix lot of partition scans in strict mode in case of error in
    partition specification error. (namit)

    HIVE-319. Add UDF for unix timestamp.
    (Hao Liu via namit)

    HIVE-363. Use 1 reducer in case of aggregations with no grouping keys.
    (namit)

    HIVE-366. Make id a non-bean attribute so that TestParse does not depend on that.
    (namit)

    HIVE-342. Fix TestMTQueries
    (Prasad Chakka via namit)

    HIVE-318. Fix union all queries. (Namit Jain via zshao)

    HIVE-367. Null Pointer when some of the files in the table are
    empty. (Namit Jain via athusoo)

    HIVE-278. Add support for Hive History to
    Hive Web UI. (Edward Capriolo via athusoo)

    HIVE-356. Treat Object[] and List<Object> differently.
    (Zheng Shao via namit)

    HIVE-373. 1 reducer should be used if no grouping key is present in all
    scenarios. (Namit Jain via zshao)

    HIVE-382. fixed problems in map-side aggr - backported from trunk.
    (namit)

    HIVE-391. Fix for UDAFCount which was not handling merging nulls
    (Namit Jain via rmurthy)

    HIVE-384. Fixing UNION ALL when the first job is a map-only job.
    (Namit Jain via zshao)

    HIVE-394. Break plans in Cluster Mode. (Namit Jain via zshao)

    HIVE-324. Fix AccessControlException when loading data.
    (Ashish Thusoo via zshao)

    HIVE-399. Fix timeout problems caused due to the bigdata test.
    (Namit Jain via athusoo)

    HIVE-397. Make union tests deterministic by ordering the
    output results. (Namit Jain via athusoo)

    HIVE-400. Fix bug in genColList. (Namit Jain via zshao)

    HIVE-390. Make partition pruner tests deterministic by ordering the
    output results. (Namit Jain via athusoo)

    HIVE-403. remove password param from job config that is submitted to job
    tracker and from log (Prasad Chakka)

    HIVE-372. Fix parse time Memory consumption for nested UDFs.
    (Zheng Shao via namit)

    HIVE-415. Fix long query parsing problems. (Namit Jain via zshao)

    HIVE-423. Change launch templates to use hive_model.jar.
    (Raghotham Murthy via zshao)

    HIVE-421. Fix union followed by multi-table insert. (Namit Jain via zshao).

    HIVE-404. Fix ordering in "SELECT * FROM t SORT BY col1 LIMIT 100" when
    query is a outer-most query.  (Namit Jain via zshao)

    HIVE-432. Fix "SORT BY" using only one reducer.
    (Zheng Shao via namit)

    HIVE-435. Fix Null pointer exception if password is null.
    (Prasad Chakka via namit)

    HIVE-416. Fix backtrack in Hive.g
    (Zheng Shao via namit)

    HIVE-442. Move the data before creating the partition.
    (Prasad Chakka via zshao)

    HIVE-447. Fix tests on hudson. (Ashish Thusoo via zshao)

Release 0.2.0 - Unreleased

  INCOMPATIBLE CHANGES

    HIVE-194. Support specifying decimal places for ROUND function.
    ROUND always rounds away from zero now. (David Phillips via zshao)

  NEW FEATURES

    HIVE-223. Single map-reduce group-by using map-side aggregation.
    (Namit Jain via zshao)

    HIVE-269. Add log/exp/pow UDF functions to Hive. (zshao)

    HIVE-258. New UDF IF(test, valueTrue, valueFalseOrNull). (zshao)

    HIVE-105. Automatically estimate number of required reducers. (zshao)

    HIVE-176. Added a history log for Hive. (Suresh Anthony via athusoo)

    HIVE-244. Add SQRT() UDF. (Jeff Hammerbacher via zshao)

    HIVE-216. Generate ruby bindings for service. (Raghotham Murthy via zshao)

    HIVE-163. JSON udf function added. (Hao Liu via zshao)

    HIVE-142. Add a metastore check command. (Johan Oskarsson via zshao)

    HIVE-91. Add ADD PARTITION support to ALTER TABLE in order to add
    partitions to a table. (Johan Oskarsson via athusoo)

    HIVE-148. Extend bin/hive to include the lineage tool.
    (Suresh Antony via zshao)

    HIVE-147. Add a tool for extracting lineage info from hive sql.
    (Suresh Antony via zshao)

    HIVE-48.  Support JDBC connections for interoperability between
    Hive and RDBMS.  (Raghotham Murthy and Michi Mutsuzaki via dhruba)

    HIVE-140. Event Based Infrastructure for Syntax Trees in the compiler.
    (Ashish Thusoo through zshao)

    HIVE-98. Dependency management with hadoop core using ivy.
    (Ashish Thusoo through zshao)

    HIVE-73. Thrift Server and Client for Hive (Raghu through zshao)

    HIVE-113. Distribute by and sort by support. (zshao)

    HIVE-118. Add date related functions. (zshao)

    HIVE-62. Support nested types.
    (Ashish Thusoo via dhruba)

  IMPROVEMENTS

    HIVE-300. DISTRIBUTE BY now supports expressions. (zshao)

    HIVE-292. Replace MetadataTypedColumnsetSerde with LazySimpleSerDe. (zshao)

    HIVE-294. Support MAP(a.*), REDUCE(a.*) and TRANSFORM(a.*). (zshao)

    HIVE-270. Add a lazy-deserialized SerDe for efficient deserialization of
    rows with primitive types. (zshao)

    HIVE-288. Removed the old serde package. (zshao)

    HIVE-240. Support CREATE TABLE IF NOT EXISTS. (zshao)

    HIVE-126. Don't fetch information on Partitions from HDFS instead of
    MetaStore.  (Johan Oskarsson via zshao)

    HIVE-209. Enabling asserts in tests. (Prasad Chakka via zshao)

    HIVE-177. Allow specifying custom input and output format in CREATE TABLE.
    (David Phillips via zshao)

    HIVE-166. Create eclipse project template. (Ashish Thusoo via zshao)

    HIVE-186. Refactor code to use a single graph, nodeprocessor, dispatcher
    and rule abstraction. (Ashish Thusoo via zshao)

    HIVE-182. Add database name parameter to getTable and dropTable.
    (Johan Oskarsson via zshao)

    HIVE-181. Restore UDFTestLength unit test for UDFs.
    (David Phillips via zshao)

    HIVE-107. Case structure for bin/hive. (Edward Capriolo via zshao)

    HIVE-101. Set svn:ignore for the root. (Johan Oskarsson via zshao)

    HIVE-170. Map-side aggregations to estimate memory size. (Namit via zshao)

    HIVE-180. Data Generator for thrift-serialized sequence files. (zshao)

    HIVE-157. Update README.txt to remove refs to mirror.facebook.com. (zshao)

    HIVE-95. Improve cli error messages by lowering backtracking to 1.
    (Pete Wyckoff through zshao)

    HIVE-102. Refactor DDLTask. (Johan Oskarsson through zshao)

    HIVE-85. New compression options for Hive. (Joydeep Sarma through zshao)

    HIVE-69. genMapRedTasks uses tree walker. (Namit through zshao)

    HIVE-249. Give execute permissions to the hive binary
    (Jeff Hammerbacher via athusoo)

    HIVE-231. Create junit reports for tests. (Johan Oskarsson via athusoo)

    HIVE-119. Make error messages more informative. (Pete Wyckoff via athusoo)

  OPTIMIZATIONS

  BUG FIXES

    HIVE-340. Fixed null pointer exception with nulls in map-side aggregation.
    (Namit Jain via zshao)

    HIVE-308. UNION ALL: FileSinkOperator now adds files in case the target
    exists. (zshao)

    HIVE-276. Fix input3_limit.q for hadoop 0.17. (zshao)

    HIVE-131. Remove uncommitted files from failed tasks.
    (Joydeep Sen Sarma via zshao)

    HIVE-264. TBinarySortable Protocol supports null characters. (zshao)

    HIVE-255. Propagate user name to Hive metastore. (Prasad Chakka via zshao)

    HIVE-263. TCTLSeparatedProtocol should use UTF-8 to encode/decode
    the data. (zshao)

    HIVE-255. Propagate user name to Hive metastore. (Prasad Chakka via zshao)

    HIVE-235. Fixed DynamicSerDe to work with null values with Thrift
    Protocols that can have missing fields for null values. (zshao)

    HIVE-222. Fixed Group by on a combination of disitinct and non distinct
    aggregates. (Ashish Thusoo via zshao)

    HIVE-161. Fixed xpath x.y when x is a null list. (zshao)

    HIVE-206. Fixed partition pruning check for uppercase table names.
    (Ashish Thusoo via zshao)

    HIVE-151. Tasks depending on other tasks cannot be a root task.
    (Namit Jain via zshao)

    HIVE-197. Fixed UDFToBoolean. (zshao)

    HIVE-171. Fixed select star with cluster by, distribute by and sort by.
    (zshao)

    HIVE-190. Fixed tests failed due to test running order. (zshao)

    HIVE-184. Tests fail due to including old hive jar files.
    (David Phillips via zshao)

    HIVE-188. Hive CLI quits when stdout is closed. (zshao)

    HIVE-104. Tables with at least 1 non-string columns to use DynamicSerDe.
    (zshao)

    HIVE-158. Make table aliases work for sampled tables in joins.
    (Raghotham Murthy via zshao)

    HIVE-168. Fixed join on a subquery with a group by. (Namit Jain via zshao)

    HIVE-169. Fixed configuration parameter used for determining join interval
    in JoinOperator. (Namit Jain via zshao)

    HIVE-114. Drop partition does not delete data for external tables now.
    (Johan Oskarsson via zshao)

    HIVE-144. Hive/ql java source copied to build/ql/java to make it work
    with eclipse. (Johan Oskarsson via zshao)

    HIVE-129. Fix aux.jar packaging to work properly with 0.17 and 0.18
    versions of hadoop. (Joydeep Sarma via zshao)

    HIVE-162. Fix join0.q test failure with hadoop 0.17. (zshao)

    HIVE-146. Fix builds for non-default build directory.
    (David Phillips through zshao)

    HIVE-47. CLI to support multiline queries from an input file.
    (Ashish through zshao)

    HIVE-103. Disable inserts in sub queries. (Namit Jain through zshao)

    HIVE-92. Fixed union all for non-embedded query. (Namit Jain through zshao)

    HIVE-93. Dynamic serde to handle _-prefixed column names in DDL.
    (Pete Wyckoff through zshao)

    HIVE-127. Fetch Task to pass the jobconf to SerDe. (Namit through zshao)

    HIVE-116. Let test depend on deploy. (Johan Oskarsson through zshao)

    HIVE-90. Fixed TestGetDBs for File.list() order.
    (Johan Oskarsson through zshao)

    HIVE-111. Support join without a ON clause. (Namit through zshao)

    HIVE-77. Thread safe query execution. (Joydeep through zshao)

    HIVE-86. Drop table should not delete data for external tables.
    (Johan Oskarsson through zshao)

    HIVE-108. Sampling to use internal column name. (Namit through zshao)

    HIVE-60. Fix the build scripts for the new hive tree.
    (Ashish through zshao)

    HIVE-54. Create this file to record the patches going into a
    particular release. (dhruba)

    HIVE-12. Improve README for Hive.
    (Ashish Thusoo via dhruba)

    HIVE-68. Fix casting to short.
    (Ashish Thusoo via dhruba)

    HIVE-70. A configuration variable that limits the amount of data
    writen by a task to its standard error.
    (Joydeep Sen Sarma via dhruba)

    HIVE-17. Remove duplicate entries for hive.metastore.uris in config file.
    (Jeff Hammerbacher via dhruba)

    HIVE-72. Generate correct results when partition pruning is not strict
    and no map-reduce jobs are needed.  (Namim Jain via dhruba)

    HIVE-75. Make limit work when applied to outermost block that is not
    a query.  (Namim Jain via dhruba)

    HIVE-76. Fix for column number mismatch between query and destination
    tables when alias.* expressions are present in the select list of a
    join. (Ashish Thusoo via dhruba)

    HIVE-196. Two test runs can run simultaneously on the same machine.
    (Ashish Thusoo via dhruba)

    HIVE-202. Fix Lineage for join queries.
    (Suresh Antony via dhruba)

    HIVE-84.  Make MetaStore Client thread safe.  (Prasad Chakka via dhruba)

    HIVE-203. Fix eclipse templates to get junit tests to run.
    (Raghotham Murthy via dhruba)

    HIVE-220. Incorrect log directory in TestMTQueries causing null pointer
    exception.  (Prasad Chakka via dhruba)

    HIVE-230.  Fix for a Null Pointer Exception that occured while loading a
    table from a query that returns empty data.  (Prasad Chakka via dhruba)

    HIVE-232. Metastore.warehouse configuration should use inherited
    hadoop configuration. (Prasad Chakka via dhruba)

    HIVE-239. Check that replace columns in alter table does not have names
    that are same as the partitioning columns. (Prasad Chakka via athusoo)

    HIVE-25. Enable Table aliases in cluster by, distribute by and sort
    by clauses. (Prasad Chakka via athusoo)

    HIVE-217. Report progress during FileSinkOperator in order to avoid
    Stream closes exceptions. (Johan Oskarsson via athusoo)

    HIVE-242. Fix to allow CLI to interpret line breaks in any CLI
    command. (Prasad Chakka via athusoo)

    HIVE-65. Rewrite typechecking to use the walker interface and add
    Resolvers to UDF and UDAF to support proper implicit casting
    in a manner similar to other RDBMSs. (athusoo)

    HIVE-246. Fix to make msck command to look for tables in hdfs
    that are in the metastore. (Johan Oskarsson via athusoo)

    HIVE-248. Create file path names properly during the load command
    in case relative path names were specified. (Prasad Chakka via athusoo)

    HIVE-179. Make substr behavior similar to other RDBMS.
    (David Phillips via athusoo)

    HIVE-257. Set hive history log location to build for tests.
    (Suresh Anthony via athusoo)

    HIVE-256. Fix in map side aggregation wherein we were not including
    private members of the records in calculating the avg size of the
    rows and we were also not estimating variable length columns
    properly. (Namit Jain via athusoo)

    HIVE-262. Fix for joins wherein a merged join having and outer or
    right outer join gave spurious rows in join. (Namit Jain via athusoo)

    HIVE-189. Make sampling tests deterministic by sorting output. (athusoo)

    HIVE-273. Fix avg UDAF which got broken hive 65. (athusoo)

    HIVE-283. Do case insensitive comparison of aliases in partition
    pruning. (athusoo)