HP XC System Software Administration Guide Version 3.2

libibverbs-utils-1.0.4-0
libipathverbs-1.0-0
libipathverbs-devel-1.0-0
libmthca-1.0.3-0
libmthca-devel-1.0.3-0
libopensm-2.0.0-0
libopensm-devel-2.0.0-0
libosmcomp-2.0.0-0
libosmcomp-devel-2.0.0-0
libosmvendor-2.0.0-0
libosmvendor-devel-2.0.0-0
librdmacm-0.9.0-0
librdmacm-devel-0.9.0-0
librdmacm-utils-0.9.0-0
mpitests_openmpi_gcc-2.0-0
mstflint-1.0-0
ofed-docs-1.1-0.noarch.rpm
ofed-scripts-1.1-0.noarch.rpm
openib-diags-1.1.0-0
openmpi_gcc-1.1.1-1
perftest-1.0-0
tvflash-0.9.0-0
ib-enhanced-services-0.9.0-1.1hptc
vltmpi-OPENIB-1.0.0_20-1.1hptc
The version numbers may differ, but it is important that the version of the kernel you are
using should be present in the version number of the kernel-ib RPM.
6. Verify that the OFED InfiniBand loadable modules are installed:
# lsmod
...
rdma_ucm 15232 0
rdma_cm 28688 1 rdma_ucm
ib_addr 10120 1 rdma_cm
ib_ipoib 60440 0
...
ib_mthca 153872 1
ib_umad 19888 0
ib_ucm 21000 0
ib_uverbs 46000 5 rdma_ucm,ib_ucm
ib_cm 40744 2 rdma_cm,ib_ucm
ib_sa 17684 3 rdma_cm,ib_ipoib,ib_cm
ib_mad 42408 4 ib_mthca,ib_umad,ib_cm,ib_sa
ib_core 60032 9 rdma_cm,ib_ipoib,ib_mthca,ib_umad,
ib_ucm,ib_uver bs,ib_cm,ib_sa,ib_mad
The sizes may differ from this output. If the modules are not loaded, there could be a
compatibility problem between the OFED RPMs and your kernel, or there is the possibility
that the version of the InfiniBand firmware is too old.
7. The InfiniBand ib0 IP interface should be up. Use the ifconfig command to display the
interface network configuration:
[root@n1 2.6.9-42.9hp.XCsmp]# ifconfig ib0
ib0 Link encap:UNSPEC HWaddr 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00
inet addr:172.31.64.1 Bcast:172.31.127.255 Mask:255.255.192.0
UP BROADCAST RUNNING MULTICAST MTU:2044 Metric:1
RX packets:31340 errors:0 dropped:0 overruns:0 frame:0
TX packets:5735 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:128
RX bytes:2680112 (2.5 MiB) TX bytes:446428 (435.9 KiB)
[root@n1 2.6.9-42.9hp.XCsmp]#
The interface should be reported as UP and RUNNING. If it is not, and you are using a dual
ported InfiniBand card, make sure that the InfiniBand cable is connected to Port 1 of the
InfiniBand card. You can try to ping other nodes that are connected to the network.
21.4 System Interconnect Troubleshooting 259