A Spark DataFrame is a distributed collection of data organized into named columns. All DataFrame operations are also automatically parallelized and distributed on clusters. Also, DataFrames are lazily evaluated like RDDs.
There's more...
Get Apache Spark 2.x Machine Learning Cookbook now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
