Dataloader/MP Reference Manual

DataLoader/MP Examples
DataLoader/MP Reference Manual—424148-003
6-2
Single Source Parallel Loading
3. The SQLCI load process for keyrange 1 reads a block of records from its
DataLoader/MP process then does a PARTONLY load of the partition with
keyrange 1.
4. At the same time, the second DataLoader/MP process for keyrange 2 reads a
block of records, does any necessary data conversions, and waits for a read from
its $RECEIVE file.
5. The SQLCI load process for keyrange 2 reads a block of records from its
DataLoader/MP process then does a PARTONLY load of the partition with
keyrange 2.
Figure 6-1 illustrates this process.
The following commands and their descriptions describe one way to accomplish the
scenario in Figure 6-1.
The following command executes a version of the DataLoader/MP process called
“db10” (created with the MAKE routine). In db10, the default user exit BUILDKEY has
been replaced by one that, given an input record, returns its key. This result is
necessary because the DataLoader/MP process uses this key to determine which
downstream DataLoader/MP process receives the record. The default BUILDKEY
Figure 6-1. Single Source Parallel Loading
Note. PRI and CPU parameters have been omitted from the example. The initial
DataLoader/MP process should run at high priority, and the downstream DataLoader/MP
process and SQLCI pairs should run in the CPU where the primary disk process for the
corresponding partition is running.
VST010
SQLCI Load
Key Range 1
SQLCI Load
Key Range 2
SQLCI Load
Key RangeN
Data Source
Part 1
Part 2
Part 3
Initial
DataLoader/
MP Process
DataLoader/MP
Key Range1
DataLoader/MP
Key Range2
DataLoader/MP
Key RangeN