Standalone master server

We are now ready to start the Spark standalone master server, as follows:

> sbin/start-master.sh

To check whether this was successful, you can examine the Spark logs as written to SPARK_LOG_DIR. Spark applications can be submitted to the standalone master server at spark://<Master IP Address>:7077 (port 7077 by default) or spark://<Master IP Address>:6066 using its REST URL in cluster mode (port 6066 by default).

The Spark Master server also provides an out-of-the-box master web User Interface (UI) in which running Spark applications and workers can be monitored and performance diagnosed. By default, this master web UI is accessible via HTTP on port 8080, in other words, http://<Master IP Address>:8080, the interface ...

Get Machine Learning with Apache Spark Quick Start Guide now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.