O'Reilly logo

Pro Spark Streaming: The Zen of Real-Time Analytics Using Apache Spark by Zubair Nabi

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

© Zubair Nabi 2016

Zubair Nabi, Pro Spark Streaming, 10.1007/978-1-4842-1479-4_4

4. High-Velocity Streams: Parallelism and Other Stories

Zubair Nabi

(1)Lahore, Pakistan

If you wish to make an apple pie from scratch, you must first invent the universe.

—Carl Sagan, Cosmos

To analyze data in motion, you must first invent the Big Data ecosystem. In this ecosystem, designing and implementing a streaming application is easy. Making it ready for prime time, on the other hand, is much harder due to the scale of the data, the complexity of the application, and the richness of the setup: every application has a plethora of moving parts. It is extremely nontrivial to optimize each application because of the plurality of knobs and their interplay. To engender ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required