Mastering Redis

Clustering Redis with Twemproxy

Twemproxy is an open source project released by Twitter for creating a caching proxy between a client and backend made up of either Memecache or Redis instances. Twemproxy separates the client calls, in our case any suitable Redis client, from the datastore backend through the use of an intermediary middleware. This middleware then implements a sharding strategy based on your preferences that are set in a configuration YAML file. Twemproxy supports twelve different hash functions including md5, crc16, two versions of crc32, four variants of the Fowler-Noll-Vo (FNV), among others with the default being a fnv1a_64 hash functions.

With Twemproxy being a C program such as Redis, the steps to get Twemproxy running require ...