Chapter 4. Real-time Trend Analysis

In this chapter, we will introduce you to trend analysis techniques using Storm and Trident. Real-time trend analysis involves identifying patterns in data streams, such as recognizing when the occurrence rate or count of certain events reaches a certain threshold. Common examples include trending topics in social media, such as when a specific hashtag becomes popular on Twitter or identifying trending search terms in a search engine. Storm originated as a project to perform real-time analytics on Twitter data, and it provides many of the core primitives required for analytical computation.

In the previous chapters, the spout implementations used were primarily simulations that used static sample data or randomly ...

Get Storm Blueprints: Patterns for Distributed Real-time Computation now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.