Sqoop 1.4.6-1710 Release Notes

The notes below relate specifically to the MapR Distribution for Apache Hadoop. You may also be interested in the Apache Sqoop 1.4.6 changelog or the Apache Sqoop project home page.

Version 1.4.6
Release Date November 2017
MapR Version Interoperability See MEP Components and OS Support and Ecosystem Support Matrix (Pre-5.2 releases)
Source on GitHub https://github.com/mapr/sqoop
GitHub Release Tag 1.4.6-mapr-1710
Maven Artifacts http://repository.mapr.com/maven/
Package Names Navigate to https://package.mapr.com/releases/MEP/ and select your MEP and OS to view the list of package names.

New in This Release

  • The release includes backports of the following issues from the Apache release:
    • SQOOP-2400: hive.metastore.sasl.enabled should be set to true for Oozie integration
    • SQOOP-2103: Not able define Decimal(n,p) data type in map-column-hive option
    • SQOOP-2406:Add support for secure mode when importing Parquet files into Hive
    • SQOOP-2597: Missing method AvroSchemaGenerator.generate()
    • SQOOP-2372: Import all tables as parquet will throw NPE
    • SQOOP-3071: Fix OracleManager to apply localTimeZone correctly in case of Date objects too
    • SQOOP-2723: Oracle connector not working with lowercase columns
    • SQOOP-2783: Query import with parquet fails on incompatible schema
    • SQOOP-2737: Cannot import table from Oracle with column with spaces in name
    • SQOOP-2909: Oracle related ImportTest fails after SQOOP-2737
    • SQOOP-3066: Introduce an option + env variable to enable/disable SQOOP-2737 feature
    • SQOOP-2863: Properly escape column names for generated INSERT statements
    • SQOOP-2911: Fix failing HCatalogExportTest caused by SQOOP-2863
    • SQOOP-2971: OraOop does not close connections properly
    • SQOOP-3033: Sqoop option --skip-dist-cache is not saved as a parameter when saving Sqoop Job
    • SQOOP-3152: --map-column-hive to support DECIMAL(xx,xx)
    • SQOOP-3157: Improve regex introduced in [SQOOP-3152] thus not causing column mapping and AVRO issues
    • SQOOP-3123: Import from oracle using oraoop with map-column-java to avro fails if special characters encounter in table name or column name
    • SQOOP-3159: Sqoop (export + --table) with Oracle table_name having '$' fails with error (ORA-00942 or java.lang.NoClassDefFoundError)
    • SQOOP-3158: Columns added to Mysql after initial sqoop import, export back to table with same schema fails
  • Support for a new --ignore-alias option, which imports data using column names from the source table rather than the default column alias names.

Patches

This MapR release includes the following patches on the base Apache release. For details, refer to the commit log for this project in GitHub.

GitHub Commit Number Data (YYYY-MM-DD) MapR Patch Number and Description

f443f5f

2017-07-10

MAPR-28281: Fixes codegen to use column names instead of column labels

8dd25f2

2017-08-04

MAPR-28662: Fixes loss in precision due to Sqoop treating Number data type in Oracle as Double in Hive

c26a90d

2017-08-10

MAPR-28773: Fixes error in import-all-tables when using --as-parquetfile option

8e83fd1

2017-08-10

MAPR-28783: Fixes Hive connection problem when using import-all-tables tool

Known Issues and Limitations

None

Resolved Issues

None