This document contains instructions to install Spark on YARN using manual steps. You can also install Spark on YARN using the MapR Installer.
Spark is distributed as two separate packages:
|mapr-spark||The mapr-spark package is dependent on the mapr-client package.|
|mapr-spark-historyserver||This optional package installs the Spark History Server.|
To install Spark on YARN (Hadoop 2), execute the following commands as
root or using
Verify that JDK 1.7 or later is installed on node where you want to install Spark.
/apps/sparkdirectory on MapR-FS and set the correct permissions on the directory.
Install the packages.On Ubuntu...On RedHat / CentOS...
Run the configure.sh command:
To test the installation, run the following command as the
This command will fail if it is run as the