YARN scheduling policies
The YARN architecture has pluggable scheduling policies that depend on the application's requirements and the use case defined for the running application. You can find the YARN scheduling configurations in the yarn-site.xml file. Here, you can specify the scheduling system as either FIFO, capacity, or fair scheduling as per the application's needs. You can also find the running application scheduling information in the ResourceManager UI. Many components of the scheduling system are defined briefly there.
As already mentioned, there are three type of scheduling policies that the YARN scheduler follows:
- FIFO scheduler
- Capacity scheduler
- Fair scheduler
The FIFO (First In First Out) scheduler
This is the scheduling policy introduced ...
Get YARN Essentials now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
