Distributed memory programming
Abstract
What makes distributed memory programming relevant to multicore platforms, is scalability: stand-alone, shared memory, multicore systems just do not have to potential to scale beyond the performance envelope of their memory bus. Attaining even higher performance is thus, relegated to collections of systems that communicate over a network.
The Message Passing Interface (MPI) covered in this chapter, can be considered as the “glue” that makes such distributed memory systems operate as cohesive platforms. MPI facilitates both point-to-point communication, and efficient collective communication operations that improve performance and reduce program clutter. In its latest incarnation, MPI-3 also ...
Get Multicore and GPU Programming now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
