Hadoop Components : Flume Release Notes

Below are release notes for the Flume component included in the MapR distribution for Apache Hadoop. Only notes specific to MapR are listed here. More details are available on the Apache Flume Project page.

Release notes for prior releases are included in the overall release notes for MapR software. See MapR Release Notes.

Flume 1.6.0-1509 Release Notes

Below are release notes for the Flume component included in the MapR Distribution for Apache Hadoop. 

 

Flume Version

1.6.0

Release Date

Oct 5, 2015

Source on GitHub

https://github.com/mapr/flume/tree/1.6.0-mapr-1509

MapR Version Compatibility

See Ecosystem Support Matrix

Maven Artifacts

http://repository.mapr.com/maven/
Package Names

The following packages are associated with this release:

  • mapr-flume-1.6.0.201509301714-1.noarch.rpm

  • mapr-flume_1.6.0.201509301714_all.deb

New in this release

For details on the features provided in Flume 1.6, see the Apache Flume release notes

Flume 1.5.0-1503 Release Notes

The notes below relate specifically to the MapR Distribution for Apache Hadoop. You may also be interested in the Apache Flume 1.5.0 changelog or the Apache Flume homepage.

 

Version

1.5.0

Release Date

March 27, 2015

Works with MapR versions

3.x, 4.0.x, 4.1

Source on GitHub

https://github.com/mapr/flume

GitHub Release Tag

1.5.0-mapr-1503

Maven Artifacts

See Maven Artifacts for MapR

Updating Flume for Compatibility with HBase 0.98

Flume 1.5 is compatible with HBase 0.94 and 0.98. 

If you are using MapR Version 4.0.x and have upgraded to HBase 0.98, you need to update the Flume 1.5 jar files as follows:

  1. Go to the directory where the Flume scripts are stored:

    cd /opt/mapr/flume/flume-<version>/bin/
  2. Execute the update script:

    bash flume-jars.sh

    During the script execution, you should see the following log messages:

    POST_YARN=1, HBASE_VERSION=0.98.4 : installing flume*-hbase.98-h2 jars

    You can now use Flume 1.5 with HBase 0.98. (See HBase 0.98.7-1501 Release Notes.)

Patches

This release from MapR includes the following patches on the base Apache release. These fixes were back-ported from Flume Version 1.5.2. For complete details, refer to the commit log for this project in GitHub.

 

Commit

Date (YYYY-MM-DD)

Comment

1d7ee182014-11-12FLUME-2549: Enable SSLv2Hello for HttpSource.
2ed1a432014-11-12FLUME-2548: Enable SSLv2Hello for Avro Source and NettyAvroRpcClient.
3d78e0b2014-11-12FLUME-2551: Add dev-support directory to source tarball.
c82f7b52014-11-05FLUME-2533: HTTPS tests fail on Java 6.
ccadd4d2014-08-05FLUME-2441: HTTP Source Unit tests failed with IBM JDK 7.
429cf962014-10-22FLUME-2511: Allow configuration of enabled protocols in Avro source and RpcClient.
b33bd462014-10-27FLUME-2520: HTTP Source should be able to block a prefixed set of protocols.

 

 

Flume 1.5.0-1501 Release Notes

The notes below relate specifically to the MapR Distribution for Apache Hadoop. You may also be interested in the Apache Flume 1.5.0 changelog or the Apache Flume homepage.

 

Version

1.5.0

Release Date

January 21, 2015

Works with MapR versions

3.x, 4.0.1, 4.0.2

Source on GitHub

https://github.com/mapr/flume

GitHub Release Tag

1.5.0-mapr-1501

Maven Artifacts

See Maven Artifacts for MapR

Updating Flume for Compatibility with HBase 0.98

Flume 1.5 is compatible with HBase 0.94 and 0.98. 

If you are using MapR Version 4.0.x and have upgraded to HBase 0.98, you need to update the Flume 1.5 jar files as follows:

  1. Go to the directory where the Flume scripts are stored:

    cd /opt/mapr/flume/flume-<version>/bin/
  2. Execute the update script:

    bash flume-jars.sh

    During the script execution, you should see the following log messages:

    POST_YARN=1, HBASE_VERSION=0.98.4 : installing flume*-hbase.98-h2 jars

    You can now use Flume 1.5 with HBase 0.98. (See HBase 0.98.7-1501 Release Notes.)

Patches

This release from MapR includes the following patches on the base Apache release. For complete details, refer to the commit log for this project in GitHub.

 

Commit

Date (YYYY-MM-DD)

Comment

7096e0f

2014-12-11

Added tmp extensions to prevent the JVM from  using jar files from other versions of HBase.

e544e94

2014-12-04

Added a script to configure Flume jars after an upgrade to HBase 0.98.

334a2bc

2014-12-04

mapr-flume-1.5.0 was built with support for HBase 0.94 and 0.98.

Flume 1.5.0-1407 Release Notes

The notes below relate specifically to MapR's Distribution for Apache Hadoop. You may also be interested in the Apache Flume 1.5.0 changelog or the Apache Flume homepage.

Version

1.5.0

Release Date

August 4, 2014

Works with MapR distribution for Hadoop versions

3.x, 4.x

Source on GitHub

https://github.com/mapr/flume

GitHub Release Tag

mapr-1.5.0-release1407

Maven Artifacts

See Maven Repository and Artifacts for MapR.

New in This Release

This is the initial release of Flume 1.5.0 on the MapR Distribution for Hadoop. This release supports MapReduce 1 and MapReduce 2 and includes all patches made to Flume version 1.4.0.

 

 

Flume 1.4.0-1310 Release Notes

The notes below relate specifically to MapR's Distribution for Apache Hadoop. You may also be interested in the Apache Flume 1.4.0 changelog or the Apache Flume homepage.

Version

1.4.0

Release Date

October 31, 2013

Works with MapR distribution for Hadoop versions

2.x, 3.x

Source on GitHub

https://github.com/mapr/flume

GitHub Release Tag

mapr-1.4.0-release+6

Maven Artifacts

See Maven Repository and Artifacts for MapR.

Patches

This release by MapR includes the following patches on the base Apache release. For complete details, refer to the commit log for this project in GitHub.

Commit

Date (YYYY-MM-DD)

Comment

e2bd125

16-Oct-2013

[FLUME-2007]. The HDFS sink now checks for the file's successful close and retries when the check fails.

90b878817-Oct-2013MapR-11752. The Flume agent JVM now recovers from HDFS I/O exceptions caused by deleting output files while the agent is running.

Flume 1.3.1+1 Release Notes

The notes below relate specifically to MapR's Distribution for Apache Hadoop. You may also be interested in the Apache Flume 1.3.1 changelog or the Apache Flume homepage.

Version

1.3.1+1

Release Date

July 12, 2013

Works with MapR distribution for Hadoop versions

1.x, 2.x, 3.x

Source on GitHub

https://github.com/mapr/flume

GitHub Release Tag

release-1.3.1-mapr+1

Maven Artifacts

See Maven Repository and Artifacts for MapR.

Patches

This release by MapR includes the following patches on the base Apache release. For complete details, refer to the commit log for this project in GitHub.

Commit

Date (YYYY-MM-DD)

Comment

0fe621e

2013-06-10

FLUME-1626 Kerberos security is now supported.