Chapter 9
High-Performance Computing
Abstract
High-Performance Computing is similar to Big Data in many ways, but is much more sensitive to access latency in messaging between nodes. This impacts networks, including switching and NICs, and is the primary reason for InfiniBand use. The migration to Remote Direct Memory Access over Ethernet is a major change with unresolved issues.
Keywords
Compression; High-performance computing; HPC; Latency; RDMA; Sparse data
High-Performance Computing (HPC) is a group term for high-powered computing that addresses scientific, oil and gas, and other very large-scale tasks. Clearly, there are enough similarities with the Big Data environment that many concepts are shared, but, at the same time, HPC has unique characteristics. ...
Get Network Storage now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
