O'Reilly logo

Real-Time Big Data Analytics by Shilpi Saxena, Sumit Gupta

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 3. Processing Data with Storm

This chapter will focus primarily on reading and processing the data using Storm. The key aspect being covered here will comprise of the ability of Storm to consume data from various sources, processing and transforming the same, and storing it to data stores. We will also help you to understand these concepts and give examples of filters, joins, and aggregators.

In this chapter, we will cover the following topics:

  • Storm input sources
  • Meet Kafka
  • Reliability of data processing
  • Storm simple patterns
  • Storm persistence

Storm input sources

Storm works well with a variety of input data sources. Consider the following examples:

  • Kafka
  • RabbitMQ
  • Kinesis

Storm is actually a consumer and process of the data. It has to be coupled ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required