Chapter 3. Process-based Parallelism

In this chapter, we will cover the following recipes:

  • Using the multiprocessing Python module
  • How to spawn a process
  • How to name a process
  • How to run a process in the background
  • How to kill a process
  • How to use a process in a subclass
  • How to exchange objects between processes
  • Using a queue to exchange objects
  • Using pipes to exchange objects
  • How to synchronize processes
  • How to manage a state between processes
  • How to use a process pool
  • Using the mpi4py Python module
  • Point-to-point communication
  • Avoiding deadlock problems
  • Collective communication using broadcast
  • Collective communication using a scatter function
  • Collective communication using a gather function
  • Collective communication using AlltoAll
  • Reduction operation
  • How to optimize ...

Get Python Parallel Programming Cookbook now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.