Introducing the lambda architecture

To the best of my knowledge, Nathan Martz, author of Apache Storm, first introduced the lambda architecture in a 2011 blog post. You can read the post yourself at http://nathanmarz.com/blog/how-to-beat-the-cap-theorem.html. In this post, Nathan proposes a new type of system that can calculate historical views of large datasets alongside a real-time layer that can answer queries for real or near-real-time data. He labels these two layers the batch layer and the real-time layer.

The Lambda architecture was derived from trying to solve the problem of answering queries for data that is continuously updated. It's important to keep in mind the type of data we're dealing with here. Streaming data in this context ...

Get Serverless Design Patterns and Best Practices now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.