Dataware for data-driven transformation

Latest Open Source Updates Include Impala, Spark, Pig and Hive

Contributed by

2 min read

The November release of the Apache open source packages in MapR was made available for customers earlier this month. We are excited to deliver some major upgrades to existing packages.

Here are the highlights:

  • Impala has been upgraded to the 1.4.1 version - although 1.2.3 continues to be supported - so upgrade when you are ready. Several interesting updates for Impala include Apache Sentry based authorization for Impala on MapR, performance improvements for the MapR platform, and the core 1.4.1 improvements for Impala including new datatypes and SQL semantics.

  • Apache Spark upgrades to 1.1.0 bringing performance and operational improvements to Spark core and new extensions to MLLib and SparkSQL.

  • We have a major update for Apache Pig with Pig 0.13 - several bug fixes and improvements across the board including handling complex data types such as Parquet.

  • Hive 0.12 and 0.13, Sqoop 1.4.4 and 1.4.5 are some of the other updates that continue to work across the previous MapR 3.1.1 release and the current 4.0.1 releases with or without YARN.

Please refer to the individual release notes for more details:

https://package.mapr.com/releases/ecosystem/ and https://package.mapr.com/releases/ecosystem-4.x/

Pig

Version: 0.13

URL: https://github.com/mapr/pig

Tag: 0.13-mapr-1410

Release notes: http://doc.mapr.com/display/components/Pig+0.13.0-1410+Release+Notes

Spark

Version: 1.1.0

URL: https://github.com/mapr/spark

Tag: v1.1.0-mapr-3.x-1410

Tag: v1.1.0-mapr-4.x-1410

Release notes: http://doc.mapr.com/display/components/Spark+and+Spark+on+YARN+1.1.0-1410+Release+Notes

Sqoop

Version: 1.4.4

URL: https://github.com/mapr/sqoop

Tag: 1.4.4-mapr-1410

Release notes: http://doc.mapr.com/display/components/Sqoop+Release+Notes

Version: 1.4.5

URL: https://github.com/mapr/sqoop

Tag: 1.4.5-mapr-1410

Release notes: http://doc.mapr.com/display/components/Sqoop+Release+Notes

Impala

Version: 1.4.1

URL: https://github.com/mapr/impala

Tag: 1.4.1-mapr-1410

Release notes: http://doc.mapr.com/display/components/Impala+1.4.1+Release+Notes

Sentry

Version: 1.4.0

URL: https://github.com/mapr/incubator-sentry

Tag: 1.4.0-mapr-1410

Release notes: http://doc.mapr.com/display/components/Sentry+1.4.0-1410+Release+Notes

Hive

Version: 0.13

URL: https://github.com/mapr/hive

Tag: 0.13-mapr-1410

Tag: 0.13-mapr-1410-protobuf241

Tag: 0.13-mapr-1410-protobuf250

Release notes: http://doc.mapr.com/display/components/Hive+0.13.0-1410+Release+Notes

Version: 0.12

URL: https://github.com/mapr/hive

Tag: 0.12-mapr-1410

Release notes: http://doc.mapr.com/display/components/Hive+0.12.0-1410+Release+Notes


This blog post was published December 01, 2014.
Categories

50,000+ of the smartest have already joined!

Stay ahead of the bleeding edge...get the best of Big Data in your inbox.


Get our latest posts in your inbox

Subscribe Now