Summary
This chapter showcased how an application is executed over a YARN cluster. The chapter started with explaining the phases involved in the execution flow for an application. These phases explicate the coordination and communication happening between the different YARN components during application execution.
We executed a sample application provided by Hadoop over the YARN cluster. For the sample application, we saw how an application is submitted to the ResourceManager and how YARN executes the containers of the application as a YarnChild process over the cluster nodes. We also covered progress reports and resource utilization through the ResourceManager web UI.
We also discussed the different failure scenarios and a brief overview about ...
Get Learning YARN now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
