Building SQL queries via database metadata
While working with source database systems, developers have to remain constantly vigilant for new system changes as they happen. Utilizing the source metadata that can be found within the database system can help generate SQL statements that remain constantly up-to-date. This will allow for source data to be captured even if the rest of an ETL transformation fails due to the new changes.
In this recipe you will create a dynamic data extracting transformation that will extract data from the books database created earlier in the chapter.
Getting ready
For this recipe you will need the database which can be created and filled by running the script books.sql. This can be found in the code for this chapter.
Get Pentaho Data Integration Cookbook Second Edition now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
