Book description
Learn the right cutting-edge skills and knowledge to leverage Spark Streaming to implement a wide array of real-time, streaming applications. This book walks you through end-to-end real-time application development using real-world applications, data, and code. Taking an application-first approach, each chapter introduces use cases from a specific industry and uses publicly available datasets from that domain to unravel the intricacies of production-grade design and implementation. The domains covered in Pro Spark Streaming include social media, the sharing economy, finance, online advertising, telecommunication, and IoT.
In the last few years, Spark has become synonymous with big data processing. DStreams enhance the underlying Spark processing engine to support streaming analysis with a novel micro-batch processing model. Pro Spark Streaming by Zubair Nabi will enable you to become a specialist of latency sensitive applications by leveraging the key features of DStreams, micro-batch processing, and functional programming. To this end, the book includes ready-to-deploy examples and actual code. Pro Spark Streaming will act as the bible of Spark Streaming.
What You'll Learn
- Discover Spark Streaming application development and best practices
- Work with the low-level details of discretized streams
- Optimize production-grade deployments of Spark Streaming via configuration recipes and instrumentation using Graphite, collectd, and Nagios
- Ingest data from disparate sources including MQTT, Flume, Kafka, Twitter, and a custom HTTP receiver
- Integrate and couple with HBase, Cassandra, and Redis
- Take advantage of design patterns for side-effects and maintaining state across the Spark Streaming micro-batch model
- Implement real-time and scalable ETL using data frames, SparkSQL, Hive, and SparkR
- Use streaming machine learning, predictive analytics, and recommendations
- Mesh batch processing with stream processing via the Lambda architecture
Who This Book Is For
Data scientists, big data experts, BI analysts, and data architects.
Table of contents
- Cover
- Frontmatter
- 1. The Hitchhiker’s Guide to Big Data
- 2. Introduction to Spark
- 3. DStreams: Real-Time RDDs
- 4. High-Velocity Streams: Parallelism and Other Stories
- 5. Real-Time Route 66: Linking External Data Sources
- 6. The Art of Side Effects
- 7. Getting Ready for Prime Time
- 8. Real-Time ETL and Analytics Magic
- 9. Machine Learning at Scale
- 10. Of Clouds, Lambdas, and Pythons
- Backmatter
Product information
- Title: Pro Spark Streaming: The Zen of Real-Time Analytics Using Apache Spark
- Author(s):
- Release date: June 2016
- Publisher(s): Apress
- ISBN: 9781484214794
You might also like
book
Scala and Spark for Big Data Analytics
Harness the power of Scala to program Spark and analyze tonnes of data in the blink …
book
Obtaining Value from Big Data for Service Systems, Volume I, 2nd Edition
This volume will assist readers in fitting big data analysis into their service-based organizations. Volume I …
video
How FINRA technology integrates data feeds to provide analytics and visuals
FINRA ingests over 50 billion records of stock market trading data daily into multipetabyte databases. Janaki …
book
Building Data Streaming Applications with Apache Kafka
Design and administer fast, reliable enterprise messaging systems with Apache Kafka About This Book Build efficient …