JobTracker Configuration

Changing any parameters in this section requires a JobTracker restart.

Parameter

Description

mapreduce.job.counters.counter.name.max

Limit on the length of counter names in jobs. Names exceeding this limit will be truncated.

Default value: 64

mapreduce.job.counters.group.name.max

Limit on the length of counter group names in jobs. Names exceeding this limit will be truncated.

Default value: 128

mapred.job.tracker

JobTracker address ip:port or use uri maprfs:/// for default cluster or maprfs:///mapr/san_jose_cluster1 to connect 'san_jose_cluster1' cluster. Replace localhost by one or more ip addresses for JobTracker.

Default value: maprfs:///

mapred.jobtracker.port

Port on which JobTracker listens. Read by JobTracker to start RPC Server.

Default value: 9001

mapred.jobtracker.ui.showcounters

Enables the CPU/memory counters for active jobs on the JobTracker node. Set the value to false to disable the CPU/memory counters. When disabled, the CPU/memory counters do not display in the JobTracker view of the MCS.

Default value: true

mapreduce.tasktracker.outofband.heartbeat

The task tracker sends an out-of-band heartbeat on task completion to improve latency. Set this value to false to disable this behavior.

Default value: true

webinterface.private.actions

By default, jobs cannot be killed from the JobTracker's web interface. Set this value to True to enable this behavior.

Warning:

MapR recommends properly securing your interfaces before enabling this behavior.

Default value: False

maprfs.openfid2.prefetch.bytes

Expert: number of shuffle bytes to be prefetched by reduce task

Default value: 0

mapr.localoutput.dir

The path for map output files on shuffle volume.

Default value: output

mapr.localspill.dir

The path for local spill files on shuffle volume.

Default value: spill

mapreduce.jobtracker.node.labels.file

The file that specifies the labels to apply to the nodes in the cluster.

mapreduce.jobtracker.node.labels.monitor.interval

Specifies a time interval in milliseconds. The node labels file is polled for changes every time this interval passes.

Default value: 120000

mapred.queue.<queue-name>.label

Specifies a label for the queue named in the <queue-name> placeholder.

mapred.queue.<queue-name>.label.policy

Specifies a policy for the label applied to the queue named in the <queue-name> placeholder. The policy controls the interaction between the queue label and the job label:

  • PREFER_QUEUE — always use label set on queue
  • PREFER_JOB — always use label set on job
  • AND (default) — job label AND node label
  • OR — job label OR node label
ipc.server.noncurrent.version.allowed

When set to true, this parameter allows IPC version mismatches. Set this parameter to false to prevent JobClient or TaskTracker code from releases prior to version 3.1 of the MapR software from running with a 3.1 JobTracker.

Default value: true