Setting up the required data for a scalable recommendation engine in Spark 2.0

In this recipe, we examine downloading the MovieLens public dataset and take a first exploratory view of the data. We will use the explicit data based on customer ratings from the MovieLens dataset. The MovieLens dataset contains 1,000,000 ratings of 4,000 movies from 6,000 users.

You will need one of the following command line tools to retrieve the specified data: curl (recommended for Mac) or wget (recommended for Windows or Linux).

Get Apache Spark 2.x Machine Learning Cookbook now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.