In this chapter, you looked at the basic concepts of large-scale data processing frameworks and also learned that one of the powerful features of spark is building applications that process real-time streaming data and produce real-time results.
In the next few chapters, we will discuss how to build real-time data search pipelines with Elasticsearch stack.