Configuring Multiple YARN Clusters (Binary)

This topic describes how to set up multiple Myriad frameworks and multiple YARN clusters in the Mesos environment for binary distribution.

  1. Set up a Myriad framework.
    Note: For each Myriad framework, setup different cluster name and resource manager hostname in yarn-site.xml file. See Using Multiple YARN Clusters for more information.
    1. Edit the myriad-config-default.yml file in the /opt/mapr/hadoop/hadoop-2.7.0/etc/hadoop/ and update the nodeManagerUri and YARN_HOME parameters:
      
      nodeManagerUri: maprfs://<full path to Hadoop tar file>
          // For example: maprfs:///dist/hadoop-2.7.0.framework1.tar.gz
      YARN_HOME: hadoop-2.7.0            
          //  (or the relative path to the hadoop directory that will be created in the tar file)
                                  
  2. Create a tar file for the Myriad framework.
    
    cd /opt/mapr/hadoop
    tar -czvf hadoop-2.7.0.framework1.tar.gz hadoop-2.7.0
                        
  3. Copy the Myriad framework tar file to the location specified by the nodeManagerUri parameter in the myriad-config-default.yml file.
  4. Repeat steps 1 - 3 for each Myriad framework.