Distributed processing with execnet
The execnet module has a share-nothing model and uses channels for communication. Channels in this context are software abstractions used to send and receive messages between (distributed) computer processes. execnet is most useful for combining heterogeneous computing environments with different Python interpreters and installed software. The environments can have different operating systems and Python implementations (CPython, Jython, PyPy, or others).
In the shared nothing architecture, computing nodes don't share memory or files. The architecture is therefore totally decentralized with completely independent nodes. The obvious advantage is that we are not dependent on any one node.
Getting ready
Install execnet ...
Get Python Data Analysis Cookbook now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
