Release Notes for Sqoop 1.4.3: March, 2013
Release Notes - Sqoop - Version 1.4.3
Sub-task
- [SQOOP-592] - Change repository location on Sqoop website
- [SQOOP-595] - Change repository location in source code
- [SQOOP-683] - Documenting sqoop.mysql.export.sleep.ms - easy throttling feature for direct MySQL exports
Bug
- [SQOOP-382] - Connection parameters should be used on the mapper
- [SQOOP-437] - Preparing release requires manual changes to LICENSE.txt file
- [SQOOP-462] - Sqoop hbase Test Compilation failure.
- [SQOOP-526] - Unable to resolve maven-scm-providers-standard
- [SQOOP-578] - sqoop script calls com.cloudera.sqoop.Sqoop instead of org.apache.sqoop.Sqoop
- [SQOOP-582] - Create a template method for job submission in Export/Import JobBase
- [SQOOP-586] - ant checkstyle has 2 errors
- [SQOOP-597] - PostgreSQL Manager is incorrectly escaping table names
- [SQOOP-599] - Import to HBase is not working on secure cluster
- [SQOOP-600] - HBase table family presence is not working correctly on new HBase versions
- [SQOOP-607] - In-process Hive CLI driver does not work
- [SQOOP-615] - Error in Avro generation
- [SQOOP-616] - HBase import/export is not working on non secure cluster where security is available
- [SQOOP-617] - User guide is missing argument --fetch-size
- [SQOOP-628] - Postgres direct import fails on non-lowercase column names
- [SQOOP-636] - ExportJobTestCase.runExport method does not reuse the existing Configuration and SqoopOptions
- [SQOOP-652] - Improve error message generated in DataDrivenDBInputFormat when no splitter is available
- [SQOOP-654] - PostgreSQL direct connector is ignoring --null(-input)string and --null(-input)-non-string arguments
- [SQOOP-657] - ant checkstyle results in errors
- [SQOOP-687] - org.apache.sqoop.tool.ExportTool.applyOptions invokes applyOutputFormatOptions(..) twice in succession
- [SQOOP-706] - Sqoop won't compile on Java 7 due to new methods in ResultSet interface
- [SQOOP-721] - Duplicating rows on export when exporting from compressed files.
- [SQOOP-725] - Enable HBase tests in sqoop 1
- [SQOOP-730] - User Guide Update: Section 3 - Sqoop Releases
- [SQOOP-741] - The OracleConnect getTables() implementation needs to restrict tables to current user
- [SQOOP-796] - Unable to use new Hadoop environment variables
- [SQOOP-808] - SQLExceptions From Batched Exports Aren't Very Helpful
- [SQOOP-818] - Missing method setConnManager(Lcom/cloudera/sqoop/manager/ConnManager;)V in ExportJobContContext breaks MS SQL Connector
- [SQOOP-821] - Hadoop has changed logic for job id in LocalJobRunner that breaks Lob* tests
- [SQOOP-824] - Sqoop code generation in 'update' export mode incompatible with '--columns' option
- [SQOOP-825] - Warning for incorrect usage of hive parameters is not checking HIVE_HOME correctly
- [SQOOP-829] - Error Messages For --map-column-java Should Be More Useful
- [SQOOP-830] - HBase import formatting BigDecimal inconsistently
- [SQOOP-840] - Inconsistent java generics declaration for exportwriter classes
- [SQOOP-853] - sqoop list-tables isn't returning the tables that have custom schemas
- [SQOOP-854] - pg_bulkload: Return value of pg_bulkload utility is being ignored
- [SQOOP-855] - pg_bulkload: NullPointerException will be thrown if user specified invalid path the binary
- [SQOOP-860] - NullPointerException when running procedure export against old database
- [SQOOP-862] - Hbase import fails if there is a row where all columns are null
- [SQOOP-870] - Allow Sqoop to import row key column into HBase
- [SQOOP-901] - Allow user to override hardcoded boolean strings in direct PostgreSQL connector
Improvement
- [SQOOP-350] - Add support for requiring that a connector be used, otherwise the job should fail
- [SQOOP-467] - Add support for Oracle BINARY_FLOAT and BINARY_DOUBLE data types
- [SQOOP-579] - Simple refactoring of org.apache.sqoop.manager.DefaultManagerFactory - extract methods for reuse
- [SQOOP-580] - Add Open-ended "teardown" routine that is called after the job execution for cleanup
- [SQOOP-598] - Document NULL substitution string changes for HIVE import
- [SQOOP-603] - Support small intervals in IntegerSplitter implementation
- [SQOOP-604] - Easy throttling feature for MySQL exports
- [SQOOP-635] - Explaining why it's important to specify weird urandom path in Troubleshooting guide
- [SQOOP-638] - Add an optional, simple and extensible validation framework for sqoop
- [SQOOP-650] - Add ability to name mapreduce job generated by Sqoop
- [SQOOP-720] - Improve error handling when exporting malformed text data
- [SQOOP-726] - Put debugging information into generated SqoopRecord class
- [SQOOP-804] - Warn if hive special arguments will be used without --hive-import
- [SQOOP-820] - Escape table name in export job only if it's required by connector
- [SQOOP-833] - add *.eml "ant eclipse" (IntelliJ import) generated file, to .gitignore
New Feature
- [SQOOP-390] - PostgreSQL connector for direct export with pg_bulkload
- [SQOOP-540] - Microsoft SQL Connector doesn't support custom schemas
- [SQOOP-601] - Support custom schemas in PostgreSQL Connector
- [SQOOP-621] - Requesting support for upsert export with MySQL
- [SQOOP-724] - Support Table hints in Microsoft SQL Server
- [SQOOP-749] - Exports Using Stored Procedures (Functions)
Task
- [SQOOP-535] - Support splitting metadata to connector and framework specific
- [SQOOP-731] - Move HBase tests to manual tests as they depend on unreleased artifacts
- [SQOOP-904] - Update Changelog for Sqoop-1.4.3
Test