MapR 5.0 Documentation : OpenStack Sahara (Liberty)

The MapR Plugin for OpenStack Sahara provides an installation and deployment implementation so that administrators of OpenStack environments and end users can set up clusters that use the MapR Distribution for Hadoop with Sahara. You can use the plugin to satisfy two main use cases:

  • On-demand provisioning of cloud-based MapR clusters

  • Running individual MapReduce jobs in a MapR cluster

The OpenStack Swift component provides object storage capabilities, and integrates with OpenStack Sahara to allow large-scale input and output data for big data applications.

See the Sahara Installation Guide for details about installing OpenStack and Sahara; these installation procedures are outside the scope of this document, which covers only the installation and use of the MapR plugin within an existing operational OpenStack/Sahara environment.

Support Matrix 

The MapR Plugin for Sahara (Liberty release) is supported in the following environments:

Software

Version

OpenStack Release

Liberty

MapR Distribution for Hadoop
(Community Edition)

3.1.1, 4.0.1, 4.0.2, 5.0.0

Supported operating systems

Ubuntu 14.04, CentOS 6.x

Earlier versions of MapR also work with the OpenStack Juno and Kilo releases. See OpenStack Sahara (Juno) and OpenStack Sahara (Kilo).

See the Ecosystem Support Matrix for details about specific versions of ecosystem components that are supported in an OpenStack deployment of MapR.

Licensing

The MapR Plugin for Sahara is not aware of MapR editions and licensing options. Every cluster you deploy in an OpenStack environment is a Community Edition (M3) of MapR unless you apply a license to the cluster manually once it is up and running.

Plugin Installation and Administration

Administrators are responsible for installing and configuring the MapR Plugin for Sahara in an operational OpenStack environment, as well as importing machine images for MapR instances. OpenStack users then set up node group and cluster definitions so they can deploy clusters in the cloud and run jobs.

To summarize, as an administrator and/or user of the plugin, you need to complete the following tasks:

OpenStack Administrator

  • Download the plugin and add it to the Sahara system.

  • Enable the plugin by editing the Sahara configuration.

  • Start Sahara with the new configuration in effect.

  • Add prebuilt images to OpenStack for specific operating systems and MapR versions. You can also build your own image by following the instructions in the README file for the plugin.

OpenStack User

  • Define node group and cluster templates (and register specific images with the MapR plugin).

  • Deploy clusters based on templates.

  • Run jobs on deployed clusters.

The following sections explain these steps in detail. The last four tasks are all done via the OpenStack dashboard (UI).