Omega
Omega is Google's next generation cluster management system.
Omega is specifically focused on a cluster scheduling architecture that uses parallelism, shared state, and optimistic concurrency control.
From the past experience, Google noticed that as the clusters and their workloads increase, the scheduler is at risk of becoming a scalability bottleneck.
Google's production job scheduler has experienced all of this. Over the years, it has evolved into a complicated, sophisticated system that is hard to change.
A schematic overview of the scheduling architectures can be seen in the following figure:
- contrib project to Hadoop 0.20 branch and is not ...
Get YARN Essentials now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
