An overview of queues

Queues are the data structures or placeholders for the applications submitted to the YARN cluster. A queue is a logical grouping of applications submitted to the YARN cluster. An application is always submitted to a queue. The scheduler then dequeues the applications based on certain parameters to allocate resources and to initiate application execution.

The basic structure of a queue is defined using an interface org.apache.hadoop.yarn.server.resourcemanager.scheduler.Queue, as shown in the following diagram:

An overview of queues

A queue object contains the following information:

  • Queue name: This is a name assigned to the queue. In case of hierarchical ...

Get Learning YARN now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.