Real-Time Big Data Analytics

Deployment and monitoring

In this section, we will discuss the various methodologies for deploying and monitoring Spark Streaming applications. Deployment and monitoring is a vast topic and it becomes complex when we talk about distributed deployments and monitoring. Discussing all aspects of Spark deployment is out of the scope of this book, but we will touch upon the various aspects of deployments and monitoring which will help us to understand the various features and flexibility provided by Spark and Spark Streaming.

Cluster managers for Spark Streaming

Spark is a framework that does not enforce any app servers or deployment stack. Spark provides the integration and deployment of Spark and Spark-based applications on various distributed cluster ...