Automatic sharding with twemproxy

A few techniques of implementing partitioning in Redis were previously presented, such as range partitioning, hash partitioning, presharding, and consistent hashing. This section will introduce a production-ready tool called twemproxy (pronounced "two-em-proxy"), which is also known as nutcracker. It was created by Twitter, released in 2012, and licensed under Apache License Version 2.0.

twemproxy is a fast and lightweight proxy for Redis and memcached protocols that implements sharding with support for multiple hashing modes, including consistent hashing. It also enables pipelining of requests and responses, and maintains persistent server connections to shard your data automatically across multiple servers. ...

Get Redis Essentials now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.