Summary

In this chapter, we have reviewed the fundamentals of neural networks and Deep Learning, including the components of feature engineering. With all this new excitement in Deep Learning, we introduced TensorFlow and how it can work closely together with Apache Spark through TensorFrames.

TensorFrames is a powerful deep learning tool that allows data scientists and engineers to work with TensorFlow with data stored in Spark DataFrames. This allows you to expand the capabilities of Apache Spark to a powerful deep learning toolset that is based on the learning process of neural networks. To help continue your Deep Learning journey, the following are some great TensorFlow and TensorFrames resources:

Get Learning PySpark now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.