In this recipe, we explore reading, parsing, and preparing a CSV file for a typical ML program. A comma-separated values (CSV) file normally stores tabular data (numbers and text) in a plain text file. In a typical CSV file, each row is a data record, and most of the time, the first row is also called the header row, which stores the field's identifier (more commonly referred to as a column name for the field). Each record consists of one or more fields, separated by commas.
Two methods of ingesting and preparing a CSV file for processing in Spark
Get Apache Spark 2.x Machine Learning Cookbook now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
