Incremental loads and performance

Most data sources grow over time, and when dealing with large volumes of data, the time taken to reload documents increases along with the size of the data.

Background

The time taken to read all the data from a file or database increases as the size of the data grows, especially if this source is on the wrong side of a firewall or on an older, slower network infrastructure.

One way to reduce the time taken for the reload is to only load from source data that has been added or changed, reducing the amount of data retrieved from the source.

The less data that needs to pulled from a database, spreadsheet, or text file, the quicker the reload will be. Reading the bulk of the data from a QVD file is substantially faster. ...

Get QlikView Unlocked now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.