HP-MPI Version 2.2 for HP-UX Release Note Manufacturing Part Number: B6060-96020 E0603 Release U.S.A. © Copyright 1979-2006 © Hewlett-Packard Development Company, L.P.
Legal Notices The information in this document is subject to change without notice. Hewlett-Packard makes no warranty of any kind with regard to this manual, including, but not limited to, the implied warranties of merchantability and fitness for a particular purpose. Hewlett-Packard shall not be held liable for errors contained herein or direct, indirect, special, incidental, or consequential damages in connection with the furnishing, performance, or use of this material. Warranty.
Intel® and Itanium® are trademarks or registered trademarks of the Intel Corporation or its subsidiaries in the United States and other countries. All other trademarks and copyrights referred to are the property of their respective owners.
HP-MPI V2.2 for HP-UX Release Note Announcement HP-MPI V2.2 for HP-UX Release Note Announcement This release note describes the release of HP-MPI Version 2.2 for HP-UX. HP-MPI 2.2 is the March 2006 release of HP-MPI, Hewlett-Packard’s fully functional implementation of the Message Passing Interface standard for HP-UX. HP-MPI 2.2 for HP-UX is supported on servers and workstations running HP-UX 11i or higher on PA-RISC and HP-UX 11i Version 2 or higher on Itanium® 2-based platforms.
HP-MPI V2.2 for HP-UX Release Note What’s in This Version What’s in This Version HP-MPI is a high-performance implementation of the Message Passing Interface standard. HP-MPI complies fully with the MPI-1.2 standard and provides full MPI-2 functionality. HP-MPI provides an application programming interface and software libraries to support parallel, message-passing applications that are efficient, portable, and flexible. HP-MPI is available as both archive and shared libraries.
HP-MPI V2.2 for HP-UX Release Note What’s in This Version rx1620 rx2600 rx2620 rx4640 rx7620 rx8620 HP Integrity Superdome Contact your InfiniBand provider to verify support on any systems not specified above. Directory Structure All HP-MPI for HP-UX files are stored in the /opt/mpi directory. The directory structure is organized as described in Table 2.
HP-MPI V2.2 for HP-UX Release Note What’s in This Version Benefits and Features MPI has become the industry standard for distributed technical applications and is widely supported on most technical computing platforms. HP-MPI offers several benefits. • Applications developed using HP-MPI port easily to other platforms, even those with a different architecture.
HP-MPI V2.2 for HP-UX Release Note What’s in This Version Description of Features The following section provides brief descriptions of the new features included in this release. For more information on HP-MPI, refer to the HP-MPI User’s Guide available at http://docs.hp.com. C++ bindings HP-MPI 2.2 supports C++ bindings as described in the MPI-2 Standard. If compiling and linking with the mpiCC command, no additional work is needed to include and use the bindings. You can include either mpi.h or mpiCC.
HP-MPI V2.2 for HP-UX Release Note What’s in This Version % mpiCC sort.C -mpiCClib /scratch/libmpicc/libmpiCC.a New mpirun command line launch options HP-MPI 2.2 supports these new mpirun command line launch options. Four new options are provided for command line job launching of the same executable across a collection of hosts.
HP-MPI V2.2 for HP-UX Release Note What’s in This Version -np 6 -hostfile hfile # 2 ranks on n1, 3 ranks on n3, and one more on n2. -hostfile hfile # 2 ranks on n1 and 3 ranks on n3. -lsb_hosts uses the environment variable established by the LSF bsub command to launch jobs across the list of hosts, using the list of hosts within $LSB_HOSTS.
HP-MPI V2.2 for HP-UX Release Note What’s in This Version rr Same as cyclic, but consider ldom load average. fill Same as block, but consider ldom load average. packed Bind all ranks to same ldom as lowest rank. ll Bind each rank to ldoms each is currently running on. map_ldom Schedule ranks on ldoms in cycle through MAP variable. Three -cpu_bind options require the specification of a map/mask description. This allows for very explicit binding of ranks to processors.
HP-MPI V2.2 for HP-UX Release Note What’s in This Version Signal Propagation HP-MPI 2.2 supports the propagation of signals from mpirun to application ranks. The mpirun executable traps the following signals and propagates them to the ranks: SIGINT SIGTERM SIGABRT SIGALRM SIGFPE SIGHUP SIGILL SIGPIPE SIGQUIT SIGSEGV SIGUSR1 SIGUSR2 SIGBUS SIGPROF SIGSYS SIGTRAP SIGURG SIGVTALRM SIGPOLL SIGCONT SIGTSTP When using an appfile, HP-MPI propagates these signals to remote HP-MPI daemons (mpid) and local ranks.
HP-MPI V2.2 for HP-UX Release Note What’s in This Version New Environment Variables The following section provides brief descriptions of the new environment variables included in this release. MPI_RDMA_MSGSIZE=a,b,c Specifies message protocol length where: a Short message protocol threshold. If the message length is bigger than this value, middle or long message protocol is used. The default is 16384 bytes. b Middle message protocol threshold.
HP-MPI V2.2 for HP-UX Release Note What’s in This Version MPI_RDMA_NONESIDED=N Specifies the number of one-sided operations that can be posted concurrently for each rank, no matter the destination. The default is 8. MPI_MAX_REMSH=N This release includes a startup scalability enhancement when using the -f option to mpirun. This enhancement allows a large number of HP-MPI daemons (mpid) to be created without requiring mpirun to maintain a large number of remote shell connections.
HP-MPI V2.2 for HP-UX Release Note What’s in This Version c The bytes of shared memory for other generic use, such as MPI_Alloc_mem() call. The default is 87.5% of the total memory. Running Applications Set the following environment variables: • If you choose to move the HP-MPI installation directory from its default location in /opt/mpi, set the MPI_ROOT environment variable to point to the location where HP-MPI is installed. • Add $MPI_ROOT/bin to PATH. • Add $MPI_ROOT/share/man to MANPATH.
HP-MPI V2.2 for HP-UX Release Note Important Notice for InfiniBand Customers Important Notice for InfiniBand Customers Under certain circumstances, a running MPI application may hang in a partial teardown state, with only a subset of the MPI ranks still running. The most likely cause for this is a reboot of the system where mpirun is running for that application.
HP-MPI V2.2 for HP-UX Release Note Important Notice for InfiniBand Customers epm MLOCK lang MLOCK users MLOCK #add entries to /etc/privgroup % setprivgrp -f /etc/privgroup A one-time setting can also be done using: /usr/sbin/setprivgrp MLOCK The above setting will not survive a reboot.
HP-MPI V2.2 for HP-UX Release Note Known Problems and Workarounds Known Problems and Workarounds • The way to add to the paths searched by man is to add an entry in /etc/man.config. To add MPI man pages, add the following line to /etc/man.config: % MANPATH /opt/mpi/share/man • Profiling routines built for C calls will no longer cause the corresponding Fortran calls to be wrapped automatically. In order to profile Fortran routines, separate wrappers need to be written for the Fortran calls.
HP-MPI V2.2 for HP-UX Release Note Known Problems and Workarounds These are kernel threads that are created to deal with page and protection faults associated with one-copy operations that HP-MPI uses to improve performance. The MPI processes are effectively single-threaded and there is no impact of the extra threads on your application. You can ignore these kernel threads during your debugging session. • Certain compiler options are incompatible with the TotalView debug information.
HP-MPI V2.2 for HP-UX Release Note Installation Requirements and Instructions Installation Requirements and Instructions HP-MPI 2.2 for HP-UX is supported on servers and workstations running HP-UX 11i or higher on PA-RISC and HP-UX 11i Version 1.6 or higher on Itanium® 2-based platforms. You must install the correct HP-MPI product for your system. After loading the HP-UX operating system, you can install HP-MPI by running the SD-UX swinstall command.
HP-MPI V2.2 for HP-UX Release Note Product Documentation Product Documentation The HP-MPI Documentation Kit is an optional product (product number B6281AA) consisting of the following hardcopy books: • MPI: The Complete Reference (2 volume set) Product number B6011-96012 • HP MPI User’s Guide (Ninth Edition) Product number B6060-96018 The HP MPI User’s Guide and HP-MPI Release Notices are available online • in /opt/mpi/doc after you install the product. • at http://docs.hp.com. • at http://www.hp.
HP-MPI V2.2 for HP-UX Release Note Product Documentation Table 3 Category Runtime Man Page Categories (Continued) Man Pages mpiclean.1 mpidebug.1 mpienv.1 mpiexec.1 mpijob.1 mpimtsafe.1 mpirun.1 mpirun.all.1 mpistdio.1 autodbl.1 Description Describes runtime utilities, environment variables, debugging, thread-safe and diagnostic libraries.
HP-MPI V2.2 for HP-UX Release Note Product Packaging Product Packaging HP-MPI is packaged as an optional software product installed in /opt/mpi.
HP-MPI V2.2 for HP-UX Release Note Software Availability in Native Languages Software Availability in Native Languages HP-MPI is enabled for Native Language Support. By default, diagnostic messages and other feedback from HP-MPI are provided in English. Support for other languages is available through the use of the Native Language Support (NLS) catalog and the internationalization environment variable NLSPATH. The default NLS search path for HP-MPI is $NLSPATH.
