HP XC System Software Administration Guide Version 3.2

22.4 Replacing a System Interconnect Board in an HP CP6000 System
Use the following procedure to replace a Myrinet system interconnect board, InfiniBand system
interconnect board, or a Quadrics system interconnect board in an CP6000 system. The example
commands in the procedure use node n3.
Caution:
The replacement system interconnect board must be the same as the system interconnect board
to be replaced.
1. Log in as superuser on the head node.
2. Ensure that no applications are running on the node with the faulty system interconnect
board:
# scontrol update NodeName=n3 State=DRAINING \
Reason="Removing node"
3. Use the stopsys command to shut down the node (on which the card is to be replaced) in
an orderly way:
# stopsys n3
4. If the faulty system interconnect board is on the head node, shut down the node with the
shutdown command:
# shutdown -h now
WARNING!
Verify that the power is disconnected to prevent injury or death.
5. Remove the old system interconnect board.
6. Install the new system interconnect board.
7. Invoke the startsys command to turn on the node's power:
# startsys --image_and_boot n3
If the node is a member of an availability set, you need to relocate its services to a “fixed”
node using the appropriate availability tool command.
“Using the System Interconnect Diagnostic Tools” (page 238) describes diagnostic tools for the
Myrinet, InfiniBand, and Quadrics system interconnects.
22.5 Software RAID Disk Replacement
Replacing a RAID disk requires that you mark the partitions faulty, remove the partitions, remove
the disk itself, and perform maintenance on the boot block.
22.5.1 Replacing a RAID Disk
Before you can replace a failed disk in a software RAID set, you must first mark each RAID
partition as faulty and remove it.
Use the mdadm command with the -f option to mark the partition faulty, and use the -r option
to remove it.
Two SATA disk drives, /dev/sda and /dev/sdb are shown in this example.
Follow these steps to replace the RAID disk:
272 Servicing the HP XC System