Avoiding update blocking on write-heavy clusters

On a write-heavy HBase cluster, you may observe an unstable write speed. Most of the writes are very fast, while some are slow. For an online system, this unstable write speed is not acceptable even when average speed is very fast.

This situation is probably caused by the following two reasons:

  • Split/compaction makes the cluster very high load
  • Updates are blocked by region server

As we described in Chapter 8, Basic Performance Tuning you can avoid the split/compaction issues by disabling the automatic split/compaction and invoking them at low load time.

Grep your region server logs, if you find many messages saying "Blocking updates for ...", it is possible that many updates were blocked, and those ...

Get HBase Administration Cookbook now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.