Handling resource localization in YARN
Resource is anything that is required by the container to execute the assigned task. Since the containers are running and managed by NodeManager on different nodes, it is the responsibility of NodeManager to make the required resources available on every node. YARN facilitates this feature of NodeManager by providing ResourceLocalizationService. This service is responsible for downloading the application resource locally to the NodeManager node's filesystem and to make it available to containers running for that application.
Resource localization terminologies
In this section, we'll discuss a few terminologies related to resource localization in YARN. In order to configure and use resource localization, it ...
Get Learning YARN now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
