SPARC® Enterprise M8000/M9000 Servers Product Notes For XCP version 1060 Order No. U41758-J-Z816-2-76 Part No.
Copyright 2007-2008 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. and FUJITSU LIMITED, 1-1, Kamikodanaka 4-chome, Nakahara-ku, Kawasaki-shi, Kanagawa-ken 211-8588, Japan. All rights reserved. Sun Microsystems, Inc.
Copyright 2007-2008 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. et FUJITSU LIMITED, 1-1, Kamikodanaka 4-chome, Nakahara-ku, Kawasaki-shi, Kanagawa-ken 211-8588, Japon. Tous droits réservés. Entrée et revue tecnical fournies par Fujitsu Limited sur des parties de ce matériel. Sun Microsystems, Inc. et Fujitsu Limited détiennent et contrôlent toutes deux des droits de propriété intellectuelle relatifs aux produits et technologies décrits dans ce document.
Contents Preface vii Technical Support vii Software Resources vii Accessing Documentation viii Fujitsu Siemens Computers Welcomes Your Comments SPARC Enterprise M8000/M9000 Servers Product Notes Supported Versions of Firmware and Software Solaris Patch Information Known Issues viii 1 1 2 4 General Functionality Issues and Limitations Notes for XCP 1050 or Later Notes for XSCF Web 4 5 5 Hardware Installation and Service Issues Notes for power-on after power-off Specific Issues and Workaroun
Software Issues 10 XCP Issues and Workarounds Solaris Issues and Workarounds 10 15 Identifying Permanent Memory in a Target Board Preparing to Upgrade to XCP 1050 or Later 26 Upgrading From XCP104x to XCP 1050 or Later Software Documentation Updates vi 26 27 32 SPARC Enterprise M8000/M9000 Servers Product Notes for XCP Version 1060 • February 2008
Preface These product notes contain late-breaking information about the SPARC® Enterprise M8000/M9000 server hardware, software, or documentation that became known after the documentation set was published. Technical Support If you have technical questions or issues that are not addressed in the SPARC Enterprise M8000/M9000 servers documentation, contact a sales representative or a certified service engineer.
Accessing Documentation Instructions for installing, administering, and using your SPARC Enterprise M8000/M9000 servers are provided in the SPARC Enterprise M8000/M9000 servers documentation set. The documentation set is available for download from the following website: http://manuals.fujitsu-siemens.com/ Note – Information in these product notes supersedes the information in the SPARC Enterprise M8000/M9000 servers documentation set. Solaris documentation is available at: http://www.sun.
SPARC Enterprise M8000/M9000 Servers Product Notes These product notes contain late-breaking information about the SPARC® Enterprise M8000/M9000 server hardware, software, or documentation that became known after the documentation set was published.
Japanese Site: http://primeserver.fujitsu.com/sparcenterprise/download/firmwa re/ Note – When the XCP version preinstalled in your server is under XCP 1060, you must upgrade to XSCF Control Package(XCP) 1060 or later. Use the web browser interface, also known as the browser user interface (BUI), to import XCP firmware and then execute the flashupdate(8) command to upgrade the XCP firmware with the XSCF Shell.
Note – See “Software Resources” on page vii for information on how to find the latest patches. Installation information and README files are included in the patch download.
Known Issues This section describes known issues in this release. General Functionality Issues and Limitations Caution – For dynamic reconfiguration (DR) and hot-plug issues, see TABLE 4. ■ Domains using the ZFS file system can not use Dynamic Reconfiguration. ■ The maximum number of IOUA (Base I/O Card) cards per domain is limited to six cards. ■ Do not use the internal CD-RW/DVD-RW drive unit and the TAPE drive unit at the same time.
■ To complete updating the OpenBoot PROM firmware in the target domain, be sure to power off/on the domain. ■ In case that Solaris OS is a single user mode, if you switch from the domain console to the XSCF Shell, Solaris OS might be started up to multi-user mode. When you operate the single user mode for Solaris OS, don't switch from the domain console to the XSCF Shell. ■ We recommend the domain to use the XSCF Unit as NTP server. In this case, needs the following attention.
Hardware Installation and Service Issues This section describes hardware specific issues and workarounds. Notes for power-on after power-off Please wait at least 30 seconds before turning on the system power that you turned off, by using the main line switch or the circuit breakers on the distribution panel. Specific Issues and Workarounds TABLE 1 lists known hardware issues and possible workarounds.
Hardware Documentation Updates TABLE 2 lists known documentation updates. TABLE 2 Documentation Updates Title Page Number Update All DVD references are now referred to as CD-RW/DVD-RW. All SPARC Enterprise M8000/M9000 servers documentation Updated glossary terms: External I/O Expansion Unit - A rack mountable device to addon PCI slots. It is connected to the system’s I/O unit through the PCIe connection and contains one or two I/O boats. I/O boat - An I/O unit in the External I/O Expansion Unit.
Updates of the SPARC Enterprise M8000/M9000 Servers Site Planning Guide The following information supersedes the information in the SPARC Enterprise M8000/M9000 Servers Site Planning Guide. Bottom Views of the Components This is to correct the description in Section 1.2.2.2, "Bottom View of the Components", FIGURE 1-18 SPARC Enterprise M8000 Server + Power Cabinet Bottom View and FIGURE 1-20 SPARC Enterprise M9000 Server (Base Cabinet) + Power Cabinet Bottom View.
FIGURE1-18 SPARC Enterprise M9000 Server (Base Cabinet) + Power Cabinet Bottom View Caster Feet Opening for cables inlet and outlet (Front view) Opening for air inlet Unit: mm (inch) SPARC Enterprise M8000/M9000 Servers Product Notes 9
Software Issues This section describes software specific issues and workarounds. XCP Issues and Workarounds TABLE 3 lists known XCP issues and possible workarounds. TABLE 3 XCP Issues and Workarounds ID Description Workaround RTIF1070418-009 While XSCF is running, a process may go down, a watchdog timeout may occur, or a hang-up may occur. After this, XSCF may reset. Check that XSCF is started.
TABLE 3 XCP Issues and Workarounds (Continued) ID Description Workaround RTIF1070824-004 On the XSCF Web, on the Domain Status screen, when you select an XSB displayed on the Domain Component List, and in case the selected XSB is not yet mounted or is Uni-XSB, the pop-up screen displays no data. None available at this time. RTIF1070824-005 On the XSCF Web, when you changed the Refresh Interval value of the Monitor Message Frame, the invalid pop-up "Confirmation Domain mode" may appear.
TABLE 3 XCP Issues and Workarounds (Continued) ID Description Workaround RTIF1070904-006 While executing the domain power-on, domain reset or DR, in case the XSCF reboot occurred, the process may be aborted in some or all of the XSB. Execute the domain reset one more time, or power off the domain and then power on again.
TABLE 3 XCP Issues and Workarounds (Continued) ID Description Workaround RTIF1071116-001 After using the addfru(8) or replacefru(8) command to hotplug a CMU, further DR operations might fail with a misleading message regarding the board being unavailable for DR. When performing the addfru(8) and replacefru(8) commands, it is mandatory to run diagnostic tests.
TABLE 3 XCP Issues and Workarounds (Continued) ID Description Workaround RTIF1071129-003 An error log cannot be registered in XSCF when the following message is displayed on Solaris OS by the External I/O Expansion Unit error: SUNW-MSG-ID: SUN4-8000-4P, TYPE: Fault None available at this time.
Solaris Issues and Workarounds TABLE 4 lists known issues and possible workarounds. TABLE 4 Specific Issues and Workarounds Concerning Solaris CR ID Description Workaround 5076574 A PCIe error can lead to an invalid fault diagnosis on a large M9000/M8000 domain. Create a file /etc/fm/fmd/fmd.conf containing the following lines; setprop client. buflim 40m setprop client.
TABLE 4 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6449315 The Solaris cfgadm(1M) command does not unconfigure a DVD drive from a domain on a SPARC Enterprise M8000/M9000 server. Disable the Volume Management Daemon (vold) before unconfiguring a DVD drive with the cfgadm(1M) command. To disable vold, stop the daemon by issuing the command /etc/init.d/volmgt stop.
TABLE 4 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6485555 On the SPARC Enterprise M8000/M9000 servers, On-board Gigabit Ethernet NVRAM corruption could occur due to a race condition. The window of opportunity for this race condition is very small. None available at this time. This bug has been fixed in Solaris 10 8/07. 6496337 The "cpumem-diagnosis" module may fail to load after uncorrectable error(UE) panic.
TABLE 4 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6502204 Unexpected error messages may be displayed on console on booting after CPU UE panic. Example: SUNW-MSG-ID: FMD-8000-11, TYPE: Defect, VER: 1, SEVERITY: Minor EVENT-TIME: Tue Jan 9 20:45:08 JST 2007 PLATFORM: SUNW,SPARC-Enterprise, CSN: 2030636002, HOSTNAME: P2-DC116-d0 If you see unexpected messages, use the XSCF command showdomainstatus(8) to check system status on XSCF.
TABLE 4 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6511374 Unexpected error messages may be displayed on console after changing the system configuration. Example: WARNING: Translation error source /LSB0/B0/0, PA 3c000000000, target /LSB0/B0/20000000 This message can be safely ignored. 6515648 "Replumb Failed" error appears when dr@0:SB1::memory fails. Once the DR operation is complete, it can be plumbed up manually.
TABLE 4 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6522017 DR and ZFS may not be used in the same domain. Reduce the amount of kernel memory that ZFS can allocate by setting the zfs_arc_max parameter in the /etc/system file. The following example sets the maximum size to 512 Mbytes. set zfs_arc_max = 0x20000000 6522433 After the CPU hardware error occurred, the fmdump(1M) command on the domain may display an incorrect faulty component.
TABLE 4 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6532215 volfs or dscp service may fail when domain is booted. Restart the service if the failure is observed. To avoid the problem, issue the following commands. svc:/platform/sun4u/dscp:default: Method "/lib/svc/method/svc-dscp start" failed with exit status 95. svc:/system/filesystem/volfs:defaul t: Method or service exit timed out. Killing contract 59.
TABLE 4 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6539084 There is a low probability of a domain panic during reboot when the Sun Quad GbE UTP x8 PCIe (X4447A-Z) card is present in a domain. There is no workaround. This bug has been fixed in 125670-01.
TABLE 4 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6551356 The system panics when running hotplug (cfgadm(1M)) to configure a previously unconfigured card. The message "WARNING: PCI Expansion ROM is not accessible" will be seen on the console shortly before the system panic.
TABLE 4 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6564934 Performing a DR deleteboard(8) operation on a board which includes Permanent Memory when using the following network cards results in broken connections: • X4447A-Z, PCI-e Quad-port Gigabit Ethernet Adapter UTP • X1027A-Z1, PCI-e Dual 10 Gigabit Ethernet Fiber XFP Low profile Adapter Re-configure the affected network interfaces after the completion of the DR operation.
TABLE 4 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6589546 prtdiag(8) command does not show all I/O devices of the following cards: • SG-XPCIE2FC-EM4 Sun StorageTek Enterprise Class 4Gb Dual-Port Fibre Channel PCI-E HBA • SG-XPCIE1FC-EM4 Sun StorageTek Enterprise Class 4Gb Single-Port Fibre Channel PCI-E HBA Use prtdiag -v for full output.
Identifying Permanent Memory in a Target Board 1. Log in to XSCF. 2. Execute the following command: XSCF> showdevices -d domain_id The following example shows a display of the showdevices -d command where 0 is the domain_id. XSCF> showdevices -d 0 ... Memory: ------DID 00 00 00 XSB 00-0 00-2 00-3 board mem MB 8192 8192 8192 perm mem MB 0 1674 0 base address 0x0000000000000000 0x000003c000000000 0x0000034000000000 domain target deleted remaining mem MB XSB mem MB mem MB 24576 24576 24576 ...
Upgrading From XCP104x to XCP 1050 or Later The following steps describe the case of upgrading to XCP1060. Note – By upgrading to XCP 1050 or later, XSCFU_B#1 will start working. When your system is using RCI network, XSCFU_B#1 needs proper configuration of cabling or termination to setup RCI network, properly. For further information, please contact a certified service engineer. Note – Do not access the XSCF units via the "Takeover IP address".
6. Collect an XSCF snapshot to archive system status prior to upgrade. XSCF> snapshot -t user@host:directory 7. The BUI on XSCFU#0 can be used to upload the XCP 1060 upgrade image. 8. Update the firmware by using the flashupdate(8) command. Caution – flashupdate(8) will update one bank, reset the XSCF and commence update of the second bank. Verify that the current and reserve banks are both updated. If both banks indicate XCP revision 1060, proceed to the next step.
13. Wait until XSCF firmware reaches the ready state. This can be confirmed when the READY LEDs of XSCF_B#0 and XSCF_B#1 remain lit. 14. Log in on to XSCFU#0 using a serial connection or LAN connection. 15. Confirm no abnormality occurred by using showlogs error -v and showstatus(8) commands. XSCF> showlogs error -v XSCF> showstatus Note – When you execute the showlogs(8) command, the following two error logs regarding the standby XSCF are displayed. These error logs can be safely ignored.
19. Confirm that both the current and reserve banks of XSCFU#1 display the updated XCP versions. XSCF> version -c xcp XSCF#1 (Active) XCP0 (Reserve): 1060 XCP1 (Current): 1060 XSCF#0 (Standby) XCP0 (Reserve): 1060 XCP1 (Current): 1060 If the Current and Reserve banks on XSCF#1 do not indicate XCP revision 1060, contact a certified service engineer. Note – Setup RCI network if RCI is used. To setup RCI network, please consult your service provider. 20. Confirm switching over between XSCFs works properly.
b. Confirm switching over between XSCFs using the following commands: XSCF> showhardconf Confirm XSCF#1 is standby, and XSCF#0 becomes active. XSCF> showlogs error Confirm new log is not recorded since you checked on Step . XSCF> showlogs event Confirm a message XSCFU entered active state from standby state. XSCF> showstatus Confirm a message "No failures found in System Initialization". 21. In case the takeover IP address is specified, confirm the IP address.
Software Documentation Updates This section contains late-breaking software information that became known after the documentation set was published and corrections in the SPARC Enterprise M8000/M9000 servers software documentation. The corrections for SPARC Enterprise M4000/M5000/M8000/M9000 servers XSCF Reference Manual, if not otherwise specified, also apply to the man pages which XSCF provides. And they supersede the information on the man pages. TABLE 5 lists known documentation updates.
