Queue Elements

Queue elements can contain the following properties:

Property Name Description
minResources Minimum resources the queue is entitled to, in the form X mb, Y vcores, Z disks. For the single-resource fairness policy, the vcores and disks values are ignored. If a queue's minimum share is not satisfied, it will be offered available resources before any other queue under the same parent. Under the single-resource fairness policy, a queue is considered unsatisfied if its memory usage is below its minimum memory share. Under dominant resource fairness, a queue is considered unsatisfied if its usage for its dominant resource with respect to the cluster capacity is below its minimum share for that resource. If multiple queues are unsatisfied in this situation, resources go to the queue with the smallest ratio between relevant resource usage and minimum. Note that a queue that is below its minimum may not immediately get up to its minimum when it submits an application, because jobs that are already running may be using those resources.
maxResources Maximum resources a queue is allowed, in the form X mb, Y vcores, Z disks. For the single-resource fairness policy, the vcores and disks values are ignored. A queue is never assigned a container that would put its aggregate usage over this limit.
maxRunningApps The limit for the number of applications that can run at once for the queue and any of its child queues. If the value of maxRunningApps for any parent queue in the queue path is lower than the value that you set for a queue, the lowest value sets the application limit.
Note: The queueMaxAppsDefault value is used for any parent queue that does not set a value for the maxRunningApps.
weight Applies a weight to share the cluster non-proportionally with other queues. Default is 1. A queue with weight 2 should receive approximately twice as many resources as a queue with the default weight.
schedulingPolicy Sets the scheduling policy of any queue. Allowed values are fifo, fair, drf or any class that extends org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.SchedulingPolicy.
  • The default, fair, considers memory when allocating resources to applications.
  • If set to fifo, applications with earlier submit times are given preference for containers, but applications submitted later may run concurrently if the cluster has leftover space after satisfying the earlier application's requests.
  • If set to drf, the drf scheduling policy considers memory, CPU, and disk usage when allocating resources to applications.
aclSubmitApps A list of users and/or groups that can submit applications to the queue. Refer to the ACLs section for more information on the format of this list and how queue ACLs work.
aclAdministerApps A list of users and/or groups that can administer a queue. Currently, the only administrative action is killing an application. Refer to the ACLs section for more information on the format of this list and how queue ACLs work.
minSharePreemptionTimeout The number of seconds the queue is under its minimum share before it tries to preempt containers to take resources from other queues.