Storing intermediate data in the memory using tHashMap
While not strictly file based, there are alternative methods for storing intermediate data which are more efficient than using temporary files, so long as there is enough memory to hold the temporary data. This recipe shows how to do this using the tHashMap
component.
Getting ready
Open the jo_cook_ch08_0040_temporaryDatatHashMap
job. You will notice that this is the same job as in the previous recipe.
How to do it...
The steps for storing intermediate data in memory using tHashMap
are as follows:
- Delete the
tCreateTemporaryfile
component. - Replace the
tFileOutputDelimited
with atHashInput
component, having a generic schema ofsc_cook_ch8_0040_genericCustomerOut
. - Replace
tFileInputDelimited
with ...
Get Talend Open Studio Cookbook now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.