10.7. Extract, Transform, and Load Products

The file transfer products continued to evolve and became extract, transform, and load (ETL) products aimed at the new databases. They added fancier “mousey-click” user interfaces, libraries of functions that could be combined via that interface, and fancier custom programming languages.

But they never got over their heritage. The intermediate file format became XML or another markup language. The proprietary programming languages started to look more like Java and C++ than BASIC to reflect the “programming language du jour” syndrome. But the underlying model for the conversion remained record-at-a-time pipeline from source to target.

The connection to a database is typically ODBC, JDBC, or other session ...

Get Joe Celko's Thinking in Sets: Auxiliary, Temporal, and Virtual Tables in SQL now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.