O'Reilly logo

Learning Storm by Anand Nalya, Ankit Jain

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 6. Integration of Storm with Batch Processing Tools

So far, we have seen how Storm can be used to develop real-time stream processing applications. In general, these real-time applications are seldom used in isolation. They are more often than not used in combination with other batch processing operations.

The most common platform to develop batch jobs is Apache Hadoop. In this chapter, we will see how applications built with Apache Storm can be deployed over existing Hadoop clusters with the help of the Storm-YARN framework for optimized use and management of resources.

In this chapter, we will cover the following topics:

  • An overview of Apache Hadoop and its various components
  • Setting up a Hadoop cluster
  • An overview of Storm-YARN
  • Deploying ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required