Software Pipelines and SOA: Releasing the Power of Multi-Core Processing

Chapter TwentyDatabase Sharding Distributor

We’ve used our examples up to this point to show you how to increase scalability. However, the “last mile” is often the final barrier to better performance. According to Pipelines Law, performance is always limited by the capacity of your downstream components. And because there’s almost always a database downstream at the end of the line, finding a way to increase its performance is vital for any scalable business application.

There are many valid techniques for improving database performance and scalability. Software Pipelines doesn’t replace them or attempt to improve on the existing techniques. Instead, it uses the pipelines concept to address the inherent bottleneck that databases present ...