Veritas Storage Foundation 5.1 SP1 for Oracle RAC Administrator"s Guide (5900-1512, April 2011)

Registered keys are lost on the coordinator disks
If the coordinator disks lose the keys that are registered, the cluster might panic
when a cluster reconfiguration occurs.
To refresh the missing keys
Use the vxfenswap utility to replace the coordinator disks with the same
disks. The vxfenswap utility registers the missing keys during the disk
replacement.
See Refreshing lost keys on coordinator disks on page 130.
Replacing defective disks when the cluster is offline
If the disk becomes defective or inoperable and you want to switch to a new
diskgroup in a cluster that is offline, then perform the following procedure.
In a cluster that is online, you can replace the disks using the vxfenswap utility.
See About the vxfenswap utility on page 122.
Review the following information to replace coordinator disk in the coordinator
disk group, or to destroy a coordinator disk group.
Note the following about the procedure:
When you add a disk, add the disk to the disk group vxfencoorddg and retest
the group for support of SCSI-3 persistent reservations.
You can destroy the coordinator disk group such that no registration keys
remain on the disks. The disks can then be used elsewhere.
To replace a disk in the coordinator disk group when the cluster is offline
1
Log in as superuser on one of the cluster nodes.
2
If VCS is running, shut it down:
# hastop -all
Make sure that the port h is closed on all the nodes. Run the following
command to verify that the port h is closed:
# gabconfig -a
3
Stop the VCSMM driver on each node:
# /sbin/init.d/vcsmm stop
Troubleshooting SF Oracle RAC
Troubleshooting I/O fencing
206