DataLoader/MX Reference Manual (G06.24+)

DataLoader/MX Examples
DataLoader/MX Reference Manual—525872-002
6-6
Multiple Source Parallel Loading
•
-E gives each of these downstream DataLoader/MX processes different files (err1,
err2, ...) in which to record their execution time errors.
•
-I directs each DataLoader/MX process to get its input from the initial
DataLoader/MX process, $dbl0.
•
-X directs the processes to call a series of user exits indicated by the string “CIU”:
°
“C” directs the process to call the user exit CONVERTIT.
°
“I” directs the process to call the user exit INSERTIT, which attempts to insert
the converted record into the database. If the insertion is successful, the
processing for that record is complete, and the process reads the next record.
°
If the insert is unsuccessful, “U” indicates that the next user exit, UPDATEIT,
should be called to update the corresponding row in the database. If the
update is successful, processing for that record is complete, and the process
reads the next record. If the update is not successful, a message is sent to the
error file indicating that no user exit was successful with this record, and the
process reads the next record:
2$ run dbl1 -E=err1 "-I=\$dbl0(recform=fb<recsize=200>)" \
-X=ciu &
3$ run dbl1 -E=err2 "-I=\$dbl0(recform=fb<recsize=200>)" \
-X=ciu &
4$ run dbl1 -E=err3 "-I=\$dbl0(recform=fb<recsize=200>)" \
-X=ciu &
...
5$ run dbl1 -E=errn "-I=\$dbl0(recform=fb<recsize=200>)" \
-X=ciu &
Multiple Source Parallel Loading
This highly parallel load scenario with write operations uses only two simple exits: one
to build the key from a raw record (the BUILDKEY exit in the initial DataLoader/MX
process) and one to convert a raw record to a suitable format (the CONVERT exit in
downstream DataLoader/MX processes).
Load requirements involve:
•
Starting with one initial DataLoader/MX process for each data source
•
Using one import process for each partition and one DataLoader/MX process that
is the input to each import process
Figure 6-3 shows multiple input streams. Suppose that you are replacing all the data in
a partitioned database.
In this example, you know the key partition boundaries and give them to the initial
DataLoader/MX process in a simple text file. You would include a user exit in each
downstream DataLoader/MX process. The user exit converts incoming records to the
format required by import and performs any other processing that might be
necessary. You can use any number of routines to do this conversion.