O'Reilly logo

InfoSphere DataStage Parallel Framework Standard Practices by Paul Christensen, Julius Lerm

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Batch data flow design
Batch applications are always constrained by execution time windows. They must complete the extraction, transformation, and load of large amounts of data in limited time windows. If the execution fits in a certain expected amount of time, performance requirements are met. However, it is not enough to meet initial expectations narrowly. Jobs must be able to scale, as data volumes grow.
Parallel batch jobs must be implemented with parallel techniques that yield the necessary scalability, which is the focus of this chapter. ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required