Chapter 6. Artificial Intelligence

In earlier chapters, we saw a pattern that combined real-time analytics using Storm with batch processing using Hadoop. In this chapter, we will go in the other direction. We will incorporate Storm into an operational system that must respond in real time to end user queries.

Typical applications of Storm focus on a never-ending stream of data. The data is often queued and processed as fast as possible by persistent topologies. The system includes a queue to accommodate varying amounts of load. At times of light load, the queue is empty. During heavy load, the queue will persist the data for eventual processing.

Even the untrained eye will recognize that such a system does not provide true real-time data processing. ...

Get Storm Blueprints: Patterns for Distributed Real-time Computation now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.