Summary

In this chapter, you learned what cleansing is about. You were introduced to the different options that PDI offers for accomplishing that task including standardizing, improving quality and deduplicating. In particular you learned to deal with non-exact matching by applying fuzzy search. Then you learned how PDI can be used for validating data. You were presented a set of common validations and the way you can implement them with PDI. You also learned how to report or fix errors that happen.

In the next chapter, you will enhance your PDI knowledge by learning how to insert code into your transformations. This will bring you an alternative to do some tasks, but mainly a way to accomplish other tasks that are complicated or even not ...

Get Learning Pentaho Data Integration 8 CE - Third Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.