2.5. The Data Changed

All of the above-mentioned technology would seem to imply that storage is not a problem any more. That is not quite true; the nature of the data we keep changed. More and more data is not being kept in text, but as video, MP3, and other media formats. Look up the bandwidth and volumes that video is using on the Internet.

These new formats require software to compact it and to convert it to other formats, as well as very specialized software to search it. For example, facial recognition is a specialized area in pattern matching. The same is true for fingerprints, maps, text, and DNA-matching software. Most of these new data formats have no ANSI/ISO Standards yet, and are not even close to a common searching language.

The ...

Get Joe Celko's Thinking in Sets: Auxiliary, Temporal, and Virtual Tables in SQL now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.