Types of queues

As mentioned earlier in this chapter, YARN defines two schedulers (capacity and fair schedulers). These schedulers use their own implementation of the queue interface. The following diagram represents a class diagram for different queues defined in YARN:

Types of queues

CapacityScheduler Queue (CSQueue)

CSQueue is an interface that extends the Queue interface. It is defined in the org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity package. The CSQueue interface represents a queue structure for a node in the tree of hierarchical queues for CapacityScheduler.

The two classes that implement the CSQueue interface are as follows:

  • ParentQueue ...

Get Learning YARN now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.