Running Jobs as mapr in Cluster Deploy Mode

This topic describes how to run jobs with Apache Spark on Apache Mesos as user 'mapr' in cluster deploy mode.

  1. Start the Mesos dispatcher, if it is not already running.
    /opt/mapr/spark/spark-2.1.0/sbin/start-mesos-dispatcher.sh --master mesos://<mesos-master-node-ip>:5050
  2. Run the job. The following example submits a job running the SparkPi sample code.
    /opt/mapr/spark/spark-2.1.0/bin/spark-submit 
        --class org.apache.spark.examples.SparkPi  
        --master mesos://<node where dispatcher is running>:7077 
        --deploy-mode cluster 
        maprfs:///user/mapr/spark-examples_2.11-2.1.0-mapr-SNAPSHOT.jar 
        100