The topic of how to program using Spark streaming and structured streaming in Spark is out of scope for this book, but we felt it is necessary to share some programs to introduce the concepts before drilling down into ML streaming offering for Spark.
For a solid introduction to streaming, please consult the following documentation on Spark:
- Information of Spark 2.0+ structured streaming is available at https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#api-using-datasets-and-dataframes
- Information of Spark 1.6 streaming is available at https://spark.apache.org/docs/latest/streaming-programming-guide.html
