Summary

In this chapter, we have defined what is meant by artificial intelligence, machine learning, and cognitive computing. We have explored common machine learning algorithms at a high level, including deep learning and ANNs, as well as taking a look at Apache Spark's machine learning library, MLlib, and how it can be used to implement these algorithms within machine learning pipelines.

In the next chapter, we will start developing, deploying, and testing supervised machine learning models applied to real-world use cases using PySpark and MLlib.

Get Machine Learning with Apache Spark Quick Start Guide now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.