Dataloader/MP Reference Manual

DataLoader/MP Reference Manual—424148-003
1-1
1 Introduction to DataLoader/MP
Dataloader/MP and native mode (NM) DataLoader/MP are software products that are
used to load and maintain NonStop SQL/MP and Enscribe databases. Both products
use the same syntax. NM Data/Loader/MP has additional capabilities that are noted in
this manual when they occur.
DataLoader/MP Features
DataLoader/MP takes full advantage of the parallelism of the NonStop SQL/MP
database product. DataLoader/MP is designed to handle massive amounts of data with
an emphasis on efficient performance.
DataLoader/MP includes the following features:
•
Efficient handling of multiple input and output streams
•
An internal file system that overcomes file size limits, handles a multiplicity of files,
and facilitates tasks such as file concatenation
•
Sampling of input data
•
Determination of partition boundaries
•
Generation of test data
•
Data extraction and loading into data marts and workstations
•
Customizable user exits that let you tailor the program to your specific needs
•
A library that supports common loading and maintenance functions such as data
conversion, hashing, and sequential I/O
The DataLoader/MP process runs as a nonprivileged batch program on NonStop
Kernel systems. If part of the loading operation is done on another platform, use a
product on that platform to extract the desired data and send it to the NonStop system.
Uses for DataLoader/MP
A typical database customer might be faced with any or all of the following problems:
•
Loading very large amounts (terabytes) of data
•
Loading large amounts (gigabytes) of data within a given time
•
Converting data to various formats
•
Loading data that comes from multiple data sources such as tape or across
communication lines from other systems
•
Other problems such as system balancing and recovery