Configuring MapR Clusters for Replication Between Streams

Configuring clusters for participation in the replication of MapR Streams streams involves configuring two or more gateways on destination clusters and, if the clusters are secure, setting up secure communications between the clusters.

  • Plan which replication topology you want to use: basic master-slave, multi-master, or a combination of these.
  • Ensure that you have administrative authority on the clusters that you plan to use.
  • In the mapr-clusters.conf file on every node in your source cluster, add an entry that lists the CLDB nodes that are in the destination cluster. This step is required for using maprcli commands and the utilities, which bypass gateways and communicate directly with the destination cluster's CLDB nodes. See mapr-clusters.conf for the format to use for the entries.
  • In the mapr-clusters.conf file on every node in your destination cluster, add an entry that lists the CLDB nodes that are in the source cluster. This step is required for running maprcli commands, as when you add upstream sources to replicas or when the destination cluster also serves as a source cluster in bi-directional replication or multi-master replication. See the topic mapr-clusters.conf for the format to use for the entry.

To configure clusters for replication between streams:

  1. Configure gateways on the destination clusters.
  2. Optional: If your clusters are secure, configure source clusters so that you can locally run maprcli commands that are executed on the destination cluster.
  3. If your clusters are secure, add one cross-cluster ticket to each source cluster for each cluster that it replicates to.
  4. Ensure that the user ID of the person who starts the replication process has the readAce permission on the volume where the source streams are located and the writeAce permission on the volumes where the replica streams are located. For information about how to set permissions on volumes, see Setting/Modifying Whole Volume ACEs.