O'Reilly logo

InfoSphere DataStage Parallel Framework Standard Practices by Paul Christensen, Julius Lerm

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Partitioning and collecting
Partitioning parallelism is key for the scalability of DataStage (DS) parallel jobs. Partitioners distribute rows of a single link into smaller segments that can be processed independently in parallel. Partitioners exist before any stage that is running in parallel. If the prior stage was running sequentially, a fan-out icon is drawn on the link in the Designer canvas, as shown in Figure 6-1.
Figure 6-1 Fan-out icon ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required