PART NUMBER EDITION NUMBER 96107 4 FLEXLINE TM Open Systems Host Attach SOLUTIONS INSTALLATION INSTRUCTIONS FOR AIX PRODUCT TYPE ONLINE STORAGE SYSTEMS
FlexLine™ 200/300 Series Installation Instructions for AIX open systems host attach
Information Control The information in this document, including any associated software program, may not be reproduced, disclosed or distributed in any manner without the written consent of Storage Technology Corporation. Should this publication be found, please return it to StorageTek, One StorageTek Drive, Louisville, CO 80028-5214, USA. Postage is guaranteed. Information in this file is subject to change. In the event of changes, the information will be revised.
Summary of Changes The following is the history and summary of changes for this publication. Date Edition Description May 2003 First Initial Release Nov 2003 Second Updates to commands and driver information. Also added a CRC webpage to obtain a permanent license for failover software.
Summary of Changes This page intentionally left blank.
AIX - Installation Instructions 1 The following pages help ensure that you order and configure a viable solution for your RS6000 operating environment running AIX 4.3.3, 5.1, or 5.2. Customers and StorageTek personnel should also be familiar with the following documents for your particular FlexLine storage solution.
AIX - Installation Instructions- Select Host Adapter (s) Pick the type and quantity of the fibre channel PCI Host Bus Adapters (HBAs) needed for your host systems.
Introduction Quantity Note: 1 Gb FC Optical Cable Description Part # 10 meters (32.8 feet) SC to SC Duplex 10800134 50 meters (164 feet) SC to SC Duplex 10800137 100 meters (328 feet) SC to SC Duplex 10800138 Other lengths are available. Consult the Siebel Configurator. Check your quantities against your earlier distance measurements to ensure your order includes all cable attachments.
AIX - Installation Instructions- ■ Installation Once you have ordered your hardware and software, read the following information on how to attach your FlexLine storage systems solution to an IBM RS/6000 server running AIX 4.3.3, 5.1, or 5.2 Before You Begin The materials needed for the installation are listed below. Check to see that you have each of these items. The following pages provide more information about these materials (see headings) with specific steps and details on what to do.
Storage Systems and Storage Manager In addition to this manual, both hardware and software information is available on the CRC and (as backup) on the following engineering web sites. http://gandalf.stortek.com/ctp/index.html http://gandalf.stortek.com/ctp/manager/index.html http://gandalf.stortek.com/ctp/installation/index.html http://gandalf.stortek.com/ctp/cabinet/index.
AIX - Installation Instructions- Note: The drive interface minihubs for high-end FlexLine are connected to both controller A and controller B. There is no need to ensure back-end fibre channel loops originate from any one host minihub. The HBAs in the AIX host are referred to as fcs0 and fcs1. Once the HBAs are installed on the host, run the lsdev command: lsdev -Ccadapter The above command returns a list of adapters, some of which will be fcs(n) for the IBM HBAs, or fscsi(n) for Cambex HBAs.
Storage System Configuration The above activities need to be done prior to going to the next section. ■ Storage System Configuration Refer to (for example) chapter one of the BladeStore Storage Manager Installation Guide P/N 96098 for doing the various storage management steps. Upgrade information will be added to the CRC or engineering web pages to provide assistance. The following is preconfiguration information for a new installation. Information for an existing storage system is provided on page 9.
AIX - Installation Instructions- Note: SANtricity Storage Manager version 9.1 is available, but it does not provide a failover option for AIX. It will be avaialble once testing is complete. Controller Firmware version (example): BC84 FW_05460700_05400400.dlp or higher Controller NVSRAM version (example): BC84 N4884-5460855-002.dlp or higher 4. Build the RAID volume groups, volumes (LUNs), mappings for host groups, hosts, host ports, and volume mappings into host groups and LUN numbers.
Storage System Configuration and the access volume is visible, it will corrupt access to the StorageTek array. Check if the packages are installed by running the command: lslpp -L devices.fcp.disk.array.* If there is no IBM storage array connected in the architecture, we recommend removing the AIX packages as follows. installp -u devices.fcp.disk.array.* This will allow you to map and use the access LUN for inband storage management operations if you chose.
AIX - Installation Instructions- # rmdev –Rdl fcs4 hdisk1 deleted hdisk2 deleted hdisk3 deleted fscsi4 deleted fcs4 deleted Example for a Cambex HBA # rmdev –Rdl fscsi5 hdisk4 deleted hdisk5 deleted fscsi5 deleted 7. Disconnect FC cables from HBAs 8. If using inband storage management, run the following command. SMagent start 9. If using Cambex DPF failover driver, run the following command. startsrc -s cbxdpfar 10.
AIX Host Installation Preparation command: lslpp -L devices.fcp.disk.array.* If there is no IBM storage array connected in the architecture, we recommend removing the AIX packages at the appropriate time in the upgrade process as follows. installp -u devices.fcp.disk.array.* Note: Do not do the command at this time because it needs to be done in the proper sequence of the software removal process. This will allow you to map and use the access LUN for inband storage management operations if you chose.
AIX - Installation Instructions- ■ AIX Host Installation/Upgrade Procedures Use the following procedures as appropriate after performing all preliminary and preparation procedures as previously discussed. Note: If you are using HACMP, you must also be using the Cambex DPF failover driver since it is the DPF driver that detects the “all paths bad” condition and triggers a node shut down to force resource groups to another node in an attempt to correct for the failure condition.
AIX Host Installation/Upgrade Procedures tar xvf stkODM_R4.2.tar (or higher) 5. install the odm entries using: ./install_stkODM 6. If the earlier architecture decision concerning the access LUN mapping versus removal of software packages devices.fcp.disk.array.* was to remove the software packages, then remove the software packages now with: installp -u devices.fcp.disk.array.* If this is a new install, a reboot is necessary at this time to pick up the ODM changes.
AIX - Installation Instructions- If no license is available at install time, use the 30-day trial key: cd /usr/lpp/cbxdpf mv license.30day license /etc/methods/cfgcbxdpf -K check or smitty devices >> Cambex Dynamic Path Management >> Manage Licensing >> Check License Expiration. There are two different licenses available for the DPF failover driver. One for Cambex HBAs and another for IBM HBAs. To request a permanent license key.
AIX Host Installation/Upgrade Procedures If the earlier architecture decision concerning the access LUN mapping versus removal of software packages devices.fcp.disk.array.* was to not remove the software packages and to remove the mapping of the access LUNs, thereby not being able to see the access LUNs, skip this section. This section is run regardless of whether you’re using a failover or non-failover solution. 1. mkdir /usr/lpp/stkfc 2. cd /usr/lpp/stkfc 3. ftp the file access.
AIX - Installation Instructions- 1. stk.svadisk (V1.1.1.0 or higher) 2. stk.renumber (V1.2.2.0 or higher) 3. stk.hacmp (V1.2.2.0 or higher) (if HACMP installed) Warning: At this time (04/26/04) there is a bug in HACMP 5.1 that will corrupt/delete the ODM table entries for HACMP event node_up and node_down if no cluster is currently defined before installing/ removing the stk.hacmp package. IY56470 fixes this problem.
AIX Host Installation/Upgrade Procedures • • • • Run cfgmgr Run lsdev - Cc disk If no hdisks are seen, move the one connected cable to the other HBA, and rerun the previous two commands. Once hdisks are detected and using a failover architecture, run the following command /usr/lpp/cbxdpf/dpfutil listall the output will look similar to the following.
AIX - Installation Instructions- hdisk2 Available 20-58-05 STK Universal XPort hdisk3 Available 10-68-01-01 Storagetek BladeStore with Path Failover hdisk4 Available 10-68-02-01 Storagetek BladeStore with Path Failover hdisk5 Available 10-68-03-01 Storagetek BladeStore with Path Failover hdisk6 Available 10-68-04-01 Storagetek BladeStore with Path Failover The STK Universal XPort entries are for the access volumes/LUNs. IF YOU ARE NOT USING THE FAILOVER SOLUTION, THE INSTALLATION IS COMPLETE.
AIX Host Installation/Upgrade Procedures autorecovery process. It is best to experiment with the advanced administration and display capabilities to understand how it all interacts. Once you understand how all of the commands work and interact, create the appropriate shell script that contains the DPFutil commands that administer/ display the primary paths for this custom installation.
AIX - Installation Instructions- Identifier:5960EC86 Label:DPF_FAILOVER Text:”MAIN PATH WRAPPED TO BACK-UP PATH” and the active I/O is switched to the good path. Repair the failing path condition, e.g.
AIX Host Installation/Upgrade Procedures After a retry limit has been reached for finding a good path, the following error message is generated. Identifier:FDB66493 Label:DPF_UNRECOV Text:”THRESHOLD HAS BEEN REACHED” The pattern of errors repeats for each LUN until the problem is corrected. All Paths Bad Condition with HACMP Disconnect all the cables from controller A and B with active I/O to all LUNs. After a few minutes the dpfutil listall command displays the following.
AIX - Installation Instructions- ■ Performance considerations There are several parameters of the disk and HBA driver that affect performance. These are addressed in the odm database parameters. The ODM settings for the storage system have already been set. See default settings in the example below. 1. The osdisk (the default disk device type) ODM settings have default queue type set to NONE and queue depth set to 1. The updated ODM settings are type = SIMPLE and depth=255.
AIX - Installation Support 2 2 The following pages are provided to support your attachment to the RS6000 AIX operating system. This chapter will: • • • help you resolve problems let you know what HBAs are supported provide information about switch configuration. ■ Introduction This document was created as a transfer of knowledge from engineering to our support personnel.
AIX - Installation Support- Errors after initial install success detailed description of problem storage system Profile storage system event log (at least last 500 entries) lsdev –Cc disk output lsdev –Cc adapter output errpt –a output lsattr –El hdisk(n) (from hdisk with problem) ps –ef > /tmp/process.log lslpp –l > /tmp/version.log Supported HBAs and Operating System The following sections provide the necessary configuration, hardware, and software requirements for the supported HBAs.
Overview The command lsdev –Cc adapter will display a list of installed adapters.
AIX - Installation Support- HBA WWN and other parameters For IBM HBAs use lscfg –vl fcs(n) (where fcs(n) is from lsdev –Cc adapter) to get more information about the HBA. For Cambex HBAs use lscfg –vl fscsi(n) (where fscsi(n) is from lsdev –Cc adapter) to get more information about the HBA. This provides the Network Address field (WWN) needed for partitioning and the microcode version (bios) field (Z9). At this time the current versions of microcode for IBM HBAs is as follows.
Overview Start trace using: /usr/lpp/cbxfc/runtrace Stop trace using: trcstop Save trace in memory to file using: trcrpt > /tmp/trc.log Device Detection The storage system should be connected to the HBA(s) and configured correctly. This includes upgrading the storage system firmware/nvsram to the latest versions.
AIX - Installation Support- not mapping UTM LUNs), agent needs to be cycled to rediscover the UTM LUNs once they show up in lsdev.
Overview • If using inband storage management, run the following command. SMagent stop • If using Cambex DPF failover driver, run the following command. stopsrc -s cbxdpfar • • Determine the Cambex adapter name (fscsi(n)) (or IBM name fcs(n)) by using the lsdev –Cc adapter command. Locate the name by finding the Camber or IBM adapter entries. In the following examples, fscsi4 and fscsi5 are the Cambex adapters and fcs0 is an IBM adapter.
AIX - Installation Support- ■ Switch Configurations Testing was done with 4116 and 3800 switches on both IBM and Cambex HBAs. The same zoning rules apply for failover as all other platforms. For those that need a refresher, a zoning web page is available at: http://gandalf.stortek.
NEED MORE INFORMATION? www.storagetek.com ABOUT STORAGETEK Storage Technology Corporation (NYSE: STK) is a $2 billion global company that enables businesses, through its information lifecycle management strategy, to align the cost of storage with the value of information. The company’s innovative storage solutions manage the complexity and growth of information, lower costs, improve efficiency and protect investments. For more information, visit www.storagetek.com, or call 1.800.275.4785 or 01.303.673.
