DataLoader/MX Reference Manual (G06.24+)

DataLoader/MX Reference Manual—525872-002
1-1
1 Introduction to DataLoader/MX
Dataloader/MX is a software product that is used to load and maintain NonStop
SQL/MP, SQL/MX, and Enscribe databases.
DataLoader/MX Features
DataLoader/MX takes full advantage of the parallelism of the NonStop SQL/MX
database product. DataLoader/MX is designed to handle massive amounts of data with
an emphasis on efficient performance.
DataLoader/MX includes these features:
•
Efficient handling of multiple input and output streams
•
An internal file system that overcomes file size limits, handles a multiplicity of files,
and facilitates tasks such as file concatenation
•
Sampling of input data
•
Determination of partition boundaries
•
Generation of test data
•
Data extraction and loading into data marts and workstations
•
Customizable user exits that let you tailor the program to your specific needs
•
A library that supports common loading and maintenance functions such as data
conversion, hashing, and sequential I/O
The DataLoader/MX process runs as a nonprivileged batch program on NonStop
Kernel systems. If part of the loading operation is done on another platform, use a
product on that platform to extract the desired data and send it to the NonStop system.
DataLoader/MX Applications
A typical database customer might be faced with any or all of these challenges:
•
Loading very large amounts (terabytes) of data
•
Loading large amounts (gigabytes) of data within a given time
•
Converting data to various formats
•
Loading data that comes from multiple data sources such as tape or across
communication lines from other systems
•
Other problems such as system balancing and recovery
You can use DataLoader/MX to build loading applications quickly and easily and to
solve these challenges. DataLoader/MX consists of a file processing program and a