Run Spark from the Spark Shell

In yarn-client mode, complete the following steps to run spark from the Spark shell:
  1. Navigate to the Spark on YARN installation directory: Substitute your Spark version in the command. For example: 1.3.1
    cd /opt/mapr/spark/spark-<version>/
  2. Issue the following command to run Spark from the Spark shell:
    MASTER=yarn-client ./bin/spark-shell
    Note: You must use yarn-client mode to run Spark from the Spark shell. The yarn-cluster mode is not supported.