Resource Allocation for Jobs and Applications

Warden determines the percentage of resources available for MapReduce v1 jobs and applications based on the warden.conf file. Applications include MapReduce v2 and non-MapReduce applications such as Spark.

Note: If you modify the values in warden.conf, you must restart Warden.

The percent of resources allocated for YARN and MapReduce v1 jobs is based on the values of the following parameters in warden.conf:

Parameter Default Description
mr1.memory.percent 50 The percentage of memory allocated to MapReduce v1 jobs.The remaining memory is allocated to applications.
mr1.cpu.percent 50 The percentage of CPUs allocated to MapReduce v1 jobs.The remaining CPUs are allocated to applications.
mr1.disk.percent 50 The percentage of disks allocated to MapReduce v1 jobs.The remaining disks are allocated to applications.
Note: These values only apply when TaskTracker and NodeManager roles are installed on a node. For example, if TaskTracker is not installed on the node, NodeManager will get 100% of the resources available to process applications regardless of the warden.conf settings. Similarly, if NodeManager is not installed on the node, TaskTracker will get 100% of the resources available to process MapReduce jobs regardless of the warden.conf settings.

This section includes the following topics: