19

image Time Data Cleaning

If you take care, time values can be cleaned independently of date values. In order to perform arithmetic, we need to ensure the time zone offset is consistent. This is usually a value in brackets that indicates hours and minutes. The time should be converted to UTC with a scanner function. The time scanner will usually scan a variety of different formats and understand them, making compensations where necessary. Then the correct GMT time value can be used to calculate time zone offsets.

Cleaning time values only becomes problematic if we try to do arithmetic with a text-based approach. This is only going to work if we are ...

Get Developing Quality Metadata now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.