O'Reilly logo

Learning Storm by Anand Nalya, Ankit Jain

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 2. Setting Up a Storm Cluster

In the last chapter, we saw how to write a minimal Storm topology and run it on the local mode and a single-node Storm cluster. In this chapter, we will cover the following topics:

  • How to run the sample topology in a distributed Storm cluster
  • How to configure the parallelism of a topology
  • How to partition a stream using different stream grouping

In the last chapter, we saw how to set up single-node ZooKeeper to use with Storm. Even though we can proceed with the same ZooKeeper setup for a distributed Storm cluster setup, then it will be a single point of failure in the cluster. To avoid this, we are deploying a distributed ZooKeeper cluster.

It is advised to run an odd number of ZooKeeper nodes, as the ZooKeeper ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required