Initial Data Assessment
“There are two possible outcomes: If the result confirms the hypothesis, then you’ve made a measurement. If the result is contrary to the hypothesis, then you’ve made a discovery.”
—Enrico Fermi, Italian Physicist (1901–1954)
Purpose
This chapter discusses the process of initial data assessment. It describes goals associated with and input to such an assessment and delves into the details of profiling data (column profiling, structure profiling). It also describes deliverables to be produced from an initial assessment. Initial data assessment produces valuable metadata (including specific baseline measurements) about the content, structure, and condition of the data being assessed. One goal of an initial assessment ...
Get Measuring Data Quality for Ongoing Improvement now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
