Hive 2.1.1-1912 (MEP 5.0.4) Release Notes

This section provides reference information, including new features, patches, known issues, and limitations for Hive 2.1.1-1912 for MEP 5.0.4.

Below are release notes for the Hive component included in the MapR Converged Data Platform. You may also be interested in the Apache Hive 2.1.1 Release Notes or the Apache Hive homepage.

These release notes contain only MapR-specific information and are not necessarily cumulative in nature. For information about how to use the release notes, see Ecosystem Component Release Notes.

Hive Version 2.1.1
Release Date December 2019
MapR Version Interoperability See Hive and HCatalog Support Matrix and Ecosystem Support Matrix and MEP Components and OS Support.
Source on GitHub https://github.com/mapr/hive
GitHub Release Tag

2.1.1-mapr-1912

Maven Artifacts See Maven Artifacts for MapR.
Package Names Navigate to https://package.mapr.com/releases/MEP/, and select your MEP and OS to view the list of package names.

Feature Support

  • MapR supports Hive-2.1.1 on Tez-0.8.4. For more information, see Tez 0.8.4-1912 (MEP 5.0.4) Release Notes.
  • MapR does not support Hive on Spark, so you cannot use Spark as an execution engine for Hive. However, you can run Hive and Spark on the same cluster. You can also use Spark SQL and Drill to query Hive tables.
  • MapR does not support HDFS encryption in Hive tables.
  • MapR does not support HBase with Hive-2.1.1 starting from mapr-core-6.0.0.
  • MapR does not support LLAP with Hive-2.1.1, as Apache Slider is not a MapR ecosystem component.
  • Starting from Hive 2.1, Hive needs to run the schematool command as an initialization step.

New Features

  • None.

Changes in Security with Default Configuration

  • None.
Important:

Because hive.users.in.admin.role and hive.security.authorization.manager were added to the default Hive configuration, some actions in Hive are restricted according to security best practices and CVE-2018-11777

The new class FallbackHiveAuthorizerFactory does the following to mitigate the above-mentioned CVE-2018-11777:

  • Disallows local file location in SQL statements for all except the administrator.
  • Allows set only selected white list parameters.
  • Disallows dfs commands for all except the administrator.
  • Disallows ADD JAR statements for all except the administrator.
  • Disallows COMPILE statements for all except the administrator.
  • Disallows TRANSFORM statements.
For more information, see Action Restrictions with Fallback Hive Authorizer.

Known Issues

PIG-25 – Pig 0.16 failed to use ORC Storage. Pig - Hive dependency issue – MapR Pig does not support MapR Hive ORC integration.

Patches

This release by MapR includes the following patches on the base Apache release. For complete details, refer to the commit log for this project in GitHub.

Commit Date (YYYY-MM-DD) Comment
6593151 2019-11-19 MAPR-HIVE-642: Joda Time Library update for Brazil to v2.10.3.jar
3ecfd64 2019-09-19 MAPR-HIVE-614: Hive on MapR DB JSON table does not honour the column's comment
4b0749d 2019-09-02 MAPR-HIVE-605: Support of Avro 1.8
ca70108 2019-09-05 MAPR-HIVE-580: Hive on Mapr-db JSON table with nested schema showing wrong results
74c6819 2019-07-17 MAPR-HIVE-559: Hive configure.sh changes hive-site.xml permissions despite having .customSecure file presence
824327a 2019-06-24 MAPR-HIVE-556: Error while starting Hive CLI on Tez: ERROR exec. Task: Failed to execute tez graph

This release by MapR also includes the following backported issues. For complete details, refer to the commit log for this project in GitHub.

Commit Date (YYYY-MM-DD) Comment
308acbc 2019-11-04 HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown. (Siddharth Seth, reviewed by Thejas Nair)
d147012 2019-06-22 HIVE-16334: Query lock contains the query string, which can cause OOM on ZooKeeper (Peter Vary via Chaoyu Tang)
ca75435 2019-06-07 HIVE-16907: "INSERT INTO" overwrite old data when destination table encapsulated by backquote
68864ac 2019-06-07 HIVE-14360: Starting BeeLine after using !save, there is an error logged: "Error setting configuration: conf"

Resolved Issues

  • None.