Hive 2.1.1-1803 (MEP 3.0.3) Release Notes

This section provides reference information, including new features, patches, known issues, and limitations for Hive 2.1-1803.

Below are release notes for the Hive component included in the MapR Converged Data Platform. You may also be interested in the Apache Hive 2.1.1 Release Notes or the Apache Hive homepage.

Hive Version 2.1.1
Release Date March 2018
MapR Version Interoperability See Hive and HCatalog Support Matrix and Ecosystem Support Matrix and MEP Components and OS Support.
Source on GitHub https://github.com/mapr/hive
GitHub Release Tag

2.1.1-mapr-1803

Maven Artifacts See Maven Artifacts for MapR.
Package Names Navigate to https://package.mapr.com/releases/MEP/, and select your MEP and OS to view the list of package names.

Feature Support

  • MapR supports Hive-2.1.1 on Tez-0.8.4. For more information, see Tez 0.8.4-1803 (MEP 3.0.3) Release Notes.
  • MapR does not support Hive on Spark, so you cannot use Spark as an execution engine for Hive. However, you can run Hive and Spark on the same cluster. You can also use Spark SQL and Drill to query Hive tables.
  • MapR does not support HDFS encryption in Hive tables.
  • MapR does not support HBase with Hive-2.1.1 starting from mapr-core-6.0.0.
  • MapR does not support LLAP with Hive-2.1.1 as Apache Slider is not a MapR ecosystem component.
  • Starting from Hive 2.1, Hive needs to run the schematool command as an initialization step.

New Features

  • Added PAM authentication support for HiveServer2 Web UI.
  • Added REST API WebHCat SSL encryption support.
  • Added separate files for HiveServer2 and HiveMetastore logs.

Patches

This release by MapR includes the following patches on the base Apache release. For complete details, refer to the commit log for this project in GitHub.

Commit Date (YYYY-MM-DD) Comment
ccf82995 2017-11-01 MAPR-29528: Cannot change hive.exec.scratchdir at runtime.
88f00ba 2017-11-10 MAPR-29571: Maprcli command start up more than one HiveMetastore process on Suse.
2da240d0 2017-11-15 MAPR-29591: Flooding of WARNING: org.apache.parquet.CorruptStatistics: Ignoring statistics because created_by could not be parsed' in application logs.
57742b60 2017-11-15 MAPR-29743: [HIVE-2.1] Some messages are missed in hive.log if HiveServer2 and HiveMetastore share in log4j config.
484eba4 2017-11-24 MAPR-30116: Create sub-folder structure if hive.exec.scratchdir is changed in runtime.
60e2cbd4 2017-11-14 MAPR-29712: UpdateInputAccessTimeHook fails for non-current database.
4004495c 2017-12-13 MAPR-30248 WebHcat logs does not work on hive-2.1.
1ac82db7 2017-12-18 MAPR-30045: [Hive-2.1] Hive WebHcat DLL does not work, Hive Job issue.
b63f1291 2018-01-22 MAPR-30556: Incorrect work with MapR Database JSON tables.
76d5a36d 2018-01-22 MAPR-HIVE-140: HiveServer2 Web UI remains unsecured in 6.0 secured by default clusters.
4c529b1 2018-02-01 MAPR-30631: Kryo exception when deserializing HiveNullValueSequenceFileOutputFormat.
235dd03 2018-01-19 MAPR-HIVE-111: Review file permissions for Hive.
19700c6 2018-02-15 MAPR-HIVE-143: REST API-WebHCat missing SSL support.
4a78363a 2018-02-19 MAPR-HIVE-146: Wrong owner of hiveversion file after hive configure.sh executed.
1d86d5c 2018-02-23 MAPR-30626: Starts up more that one process for hive services on CentOS 6.8.

This release by MapR also includes the following backported issues. For complete details, refer to the commit log for this project in GitHub.

Commit Date (YYYY-MM-DD) Comment
63eae24 2017-11-07 HIVE-17664: Refactor and add new tests.
79cd8c5

2017-11-27

HIVE-14139: NPE dropping permanent function.
9d991a8e 2017-12-03 HIVE-16950: Dropping hive database/table which was created explicitly in default database location, deletes all databases data from default database location.
d128066 2017-12-19 HIVE-16050: Regression: Union of null with non-null.
c65b75d7 2018-01-22 HIVE-13864: Beeline ignores the command that follows a semicolon and comment.
0127924 2018-01-22 HIVE-16935: Hive should strip comments from input before choosing which CommandProcessor to run.
67c4d4ce 2018-01-22 HIVE-17050: Multiline queries that have comment in middle fail when executed via "beeline -e".
102ab8b3 2018-01-22 HIVE-18127: Do not strip '--' comments from shell commands issued from the CLIDriver.
2fec4cea 2018-02-05 HIVE-17731: Add a backward compat option for external users to HIVE-11985.

Known Issues and Limitations

  • The hive-site.xml file permissions is 640.
  • For accessing and using Hive, administrators have the ability to manage permissions for "Other" users. There are at least two available options on how to enable the using of hive-site.xml:
    1. Add users who want to work with Hive to a mapr group.
    2. Set permission to 644 to make it world-readable.