In this recipe, we demonstrate how to use DataFrame SQL capabilities to perform basic CRUD operations, but there is nothing limiting you from using the SQL interface provided by Spark to any level of sophistication (that is, DML) desired.
Using DataFrames with standard SQL language - SparkSQL
Get Apache Spark 2.x Machine Learning Cookbook now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.