Apache Spark 2.x Machine Learning Cookbook

How to do it

1. Start a new project in IntelliJ or in an IDE of your choice. Make sure the necessary JAR files are included.

2. Set up the package location where the program will reside:

package spark.ml.cookbook.chapter10

3. Import the necessary packages for the Spark context to get access to the cluster and Log4j.Logger to reduce the amount of output produced by Spark:

import org.apache.spark.mllib.evaluation.MulticlassMetricsimport org.apache.spark.mllib.tree.DecisionTreeimport org.apache.spark.mllib.linalg.Vectorsimport org.apache.spark.mllib.regression.LabeledPointimport org.apache.spark.mllib.tree.model.DecisionTreeModelimport org.apache.spark.rdd.RDDimport org.apache.spark.sql.SparkSessionimport org.apache.log4j.{Level, Logger} 

4. Create ...