StorageNet Fibre Channel Switch 4000 SES (SCSI-3 Enclosure Services) User Guide 8946121402
StorageNet Fibre Channel Switch 4000 SES (SCSI-3 Enclosure Services) User Guide 8946121402
Revision History Tab Level/Date Description 01 (08/98) Initial release. 02 (03/99) Manual release corresponding to Release 1.6a. The U.S. Department of Commerce restricts the distribution of technical information contained in this document when exported outside the U.S. Therefore, careful attention should be given to compliance with all applicable U.S. Export Laws if any part of this document is to be exported. © 1999 Storage Technology Corporation, Louisville, Co. All rights reserved.
About This Document Introduction Use this guide for monitoring, configuring, and maintaining a StorageNet Fibre Channel Switch 4000 through SCSI-3 Enclosure Services (SES). You should be knowledgeable about networking in general, routing and bridging in particular. A clearly defined network and security plan is necessary. Your security plan should assess the possible risks to your network and define access policies to deal with those risks.
Notice to the Reader The material contained in this publication is for informational purposes only and is subject to change without notice. StorageTek is not responsible for the use of any product options or features not described in this publication, and assumes no responsibility for any errors that may appear in this publication. Refer to the revision history (at the beginning of this document) to determine the revision level of this publication.
Table of Contents Chapter 1 Product Overview Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-1 SES Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-1 Chapter 2 SES Concepts Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-1 SES Functional Model . . . . .
Chapter 4 Troubleshooting Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-1 License Reject . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-1 CHECK CONDITION . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-1 Invalid Field Errors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
List of Figures Figure 1-1 SES Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-2 Figure 2-1 SES Distribution . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-1 Figure 2-2 SES Functional Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
viii 8946121402
List of Tables Table 1-1 Example LUN Mapping Table 2-1 Format of LUN recognized by SESD . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-2 Table 2-2 LUN Mapping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-2 Table 3-1 Constructs, Commands and Diagnostic Pages . . . . . . . . . . . . . . . . . . . . .3-1 Table 3-2 FCP Information Unit Descriptions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
x 8946121402
Chapter 1 Product Overview Introduction This chapter describes StorageTek’s implementation of SES (SCSI-3 Enclosure Services) on the StorageNet Fibre Channel Switch 4000. SES implementation in a SCSI-3-based Host Adapter is up to the adapter manufacturer and StorageTek cannot determine their implementation. Therefore, the focus of this guide is to discuss StorageTek’s implementation of SES within the Fabric. Note: Currently, the SES standard is in DRAFT status and is subject to change.
SES Management Figure 1-1 SES Overview LUN addressing within the Fabric can be non-sequential because it is based on the switch’s Domain_ID. Table 1-1 shows the sample LUN mapping used with Figure 1-1.
SES Management Therefore, if there are 5 switches in the Fabric SES reports 6 LUNs, one LUN value for each switch and LUN0 for the local client connection. Other SCSI-3 enclosures can also run SES outside the Fabric, such as JBODs, RAID-5 arrays, SCSI-3 hard drives, and SCSI-3 tape drives. These devices are identified by their Fabric and SCSI addresses, and are assigned LUNs using standard SCSI-3 host adapter LUN addressing.
SES Management 1-4 8946121402
Chapter 2 SES Concepts Introduction This chapter uses generic terms to describe enclosure services and specific SES implementation. SES instances can be distributed inside and outside of the Fabric to any enclosure capable of supporting enclosure services through an SES device. SES is distributed transparently throughout the Fabric, with an instance of a distributed SES Device (SESD) on each switch as shown in Figure 2-1.
SES Functional Model Figure 2-2 SES Functional Model SES Application Client SES Request SES Response SES Device FCP Port FCP Command FCP Response FCP _Port Request Sequence Response Sequence FC-PH FC-PH At the Fibre Channel level, each SESD is accessible through the Fibre Channel well known address, FFFFFAh (Management Server). At the SCSI-3 level, it is associated with a LUN. An SES Application Client can refer to any distributed SESD within the Fabric using its LUN.
Access to the Enclosure Services Process An SES Application Client may easily find the LUN values of all distributed SESDs inside the Fabric by using the Report LUNs command. See the “Report LUNs” section in Chapter 3 for more information. Access to the Enclosure Services Process An application client can monitor all enclosures capable of processing the enclosure services command set with SES instances distributed throughout a Storage Area Network (SAN).
Indicators and Control Management 2-4 8946121402
Chapter 3 SES Commands Introduction This chapter contains information and examples on managing SES, including the following: • FC-PH constructs • FCP and SES commands • Diagnostics pages Note: SESD can be accessed from any Fabric switch licensed to run SES. Constructs, Commands and Diagnostic Pages Table 3-1 summarizes the FC-PH constructs, FCP commands, and SES commands.
FCP Constructs Table 3-1 Constructs, Commands and Diagnostic Pages (Continued) Command Description Report LUNs Contains information returned from SESD containing the LUNs attached to the SESD. Request Sense Used to sense information from the SESD. Send Diagnostic Used to configure/diagnose a logical unit. Test Unit Ready Used to test an LUNs operation state. Reject Contains information and status about a unit’s failure.
FCP Constructs Table 3-3 FCP_CMND IU Format Byte Size Field Name Byte Number Description 8 FCP_LUN 0-7 Logical Unit Number 4 FCP_CNTL 8 - 11 Control flags and bits for task/execution management 16 FCP_CDB 12 - 27 SCSI command descriptor block 4 FCP_DL 28 - 31 Data Length The FCP_LUN value format is described in Table 3-3 or the value is 0. The latter refers to the SESD on the local switch.
FCP and SES Commands Table 3-5 shows the FCP_STATUS field format. Table 3-5 FCP_STATUS Format Byte Bit Definition 0 7 .. 0 Reserved 1 7 .. 0 Reserved 7 .. 4 Reserved 3 FCP_RESID_UNDER 2 FCP_RESID_OVER 1 FCP_SNS_LEN_VALID 0 FCP_RSP_LEN_VALID 7 .. 0 SCSI status byte from the SCSI logical unit (not used) 2 3 The reserved bits are set to 0 by the SESD.
FCP and SES Commands Switch Diagnostics Pages Before each SCSI command is discussed in detail, the diagnostics pages are defined in Table 3-7. They are particularly relevant to two commands: Receive Diagnostic Results and Send Diagnostics. The switch SESD supports 7 diagnostics pages.
FCP and SES Commands Table 3-9 Page Code 0 Format – Supported Diagnostic Pages (Continued) Byte/Bit 7 2 (MSB) 6 3 5 4 3 2 1 Page Length = 7 4 00h 5 80h 6 81h 7 82h 8 83h 9 84h 10 85h 0 (LSB) Switch Page If requested using the Send Diagnostic or Receive Diagnostic Result command, the SESD returns the response shown in Table 3-10. Table 3-10 Switch Page Format Byte/Bit Field # Access 7 6 5 4 3 2 0 na na Page Code = 80h 1 na na Reserved 2 ..
FCP and SES Commands The field swValid is bit mapped and indicates which subsequent fields within the page are valid. The bit position for subsequent fields starts from 0, as indicated in the Field # column of Table 3-10. For example, if the fields: Current_Date, Boot_Date and Number_of_Sensors are valid, it contains the hex value of 0003h. Sensor Table Page If requested using the Send Diagnostic or Receive Diagnostic Result command, the SESD returns the response shown in Table 3-11.
FCP and SES Commands Table 3-12 Format of Fabric Page (Continued) Byte/Bit Field # Access 7 6 5 4 12 .. 15 1 ro PrincipalSwitchFlag 16 .. 19 2 ro NumberOfImmediateNeighbor 20 .. 23 3 ro NumberOfFabricISL_Entries 3 2 1 0 Neighborhood Table Page If requested using the Send Diagnostic or Receive Diagnostic Result command, the SESD returns the response shown in Table 3-13.
FCP and SES Commands Table 3-14 Fibre Channel Port Table Page Format 8946121402 Byte/Bit Field # Access 7 6 5 4 3 2 1 0 0 na na Page Code = 84h 1 na na Reserved 2 .. 3 na na Page Length = n - 3 4 .. 7 na na swNumEntries = i – specifies the number of entries received. Note: Each entry consists of swValidity[0] field through field 27. 8 .. 11 na rw swValidity[0] 12 .. 15 0 ro swFCPortIndex[0] 16 .. 19 1 ro swFCPortType[0] 20 .. 23 2 ro swFCPortPhyStatus[0] 24 ..
FCP and SES Commands Table 3-14 Fibre Channel Port Table Page Format (Continued) Byte/Bit Field # Access 7 108 .. 111 24 ro swFCPortTxMcasts[0] 112 .. 115 25 ro swFCPortLipIns 116 .. 119 26 ro swFCPortLipOuts 120 .. 123 27 ro swFCPortLipLastAlpa .. ... more instances of swFCPortEntry (swValidity .. swFCPortTxMcasts) if applicable ... (n-4)..
FCP and SES Commands Inquiry An SES Application Client may send an Inquiry command to obtain information about a switch in the Fabric. The format of the FCP_CDB is shown in Table 3-16.
FCP and SES Commands If the field, EVPD is set to 1, then the value of the page code may be set to one of the codes shown in Table 3-18. Table 3-18 Page Codes Page Code Description 00h Supported vital product data pages 80h Unit Serial Number Page 83h Device Identification Page If the page code is set to 00h, the SESD will return codes shown in Table 3-19.
FCP and SES Commands If the page code is set to 83h, the SESD will return codes shown in Table 3-21. Table 3-21 SESD Return Codes for 83h Byte/Bit 7 0 Peripheral qualifier = 0 1 Page Code = 83h 2 Reserved 3 Page length = 32 4 Reserved = 0 Code set = 2 5 Reserved = 0 Identifier type = 1 6 Reserved = 0 7 Identifier length = 28 8 Identifier = Vendor Identification (8 bytes) + Product identification (16 bytes) + Product revision level (4 bytes) See Table 3-17. ...
FCP and SES Commands Report LUNs An SES Application Client sends a Report LUNs command to obtain the number of logical units (each is a switch in SCSI impersonation) in the Fabric. The CDB format is shown in Table 3-23. Table 3-23 Report LUNs Command Format Byte/Bit 7 6 5 0 Operation Code = A0h 1 .. 5 Reserved 6 .. 9 Allocation Length 10 Reserved 11 Control = 0 4 3 2 1 0 The SESD reports the LUNs of associated switches with the format shown in Table 3-24.
FCP and SES Commands Send Diagnostic A SES Application Client can use a Send Diagnostic command to configure/diagnose a logical unit. After the command completion, the SES Application Client sends a Receive Diagnostic Results command. See Table 3-22. The FCP_CDB format is shown in Table 3-26. Table 3-26 Send Diagnostic Command Format Byte/Bit 7 6 5 0 Operation Code = 1Dh 1 Reserved 2 Reserved 3 ..
FCP and SES Commands Reject The SESD issues a Reject command to set status to Check Condition and the appropriate values for the Sense Key (SK) field. Additional Sense Code (ASC) and Additional Sense Code Qualifier (ASCQ) values are as shown in Table 3-28.
Chapter 4 Troubleshooting Introduction This chapter discusses the SEND DIAGNOSTIC command error messages. License Reject A license reject is generated when the SES license key is improperly entered or is not installed. The following message is generated: Probable cause: Invalid Field Action: See the “Reject” section in Chapter 3 for more information. CHECK CONDITION CHECK CONIDITION is generated when the SES Device (SESD) terminates an operation because an error was encountered.
Introduction 4-2 8946121402
Appendix A Glossary Application Client: The source object of the SCSI commands and destination for the command responses. Byte: A group of 8 bits. Command Descriptor Block: The structure of up to 16 bytes in length used to communicate commands from the application client to a device server. Critical Condition: An enclosure condition where one or more elements inside the enclosure have failed or are outside of operational parameters.
Logical Unit: A target-resident entity that implements a device model and executes SCSI commands originated by an application client. Logical Unit Number: A device or element known by an enclosure that identifies it to the application client. Redundancy: The presence in an enclosure of one or more elements capable of automatically taking over the functions of a failed element. SCSI: Small Computer Systems Interface.
Index A Device Slot A-1 Application Client A-1 Device Type A-1 ASC Field 3-16 Diagnostics Pages 3-5 ASCQ Field 3-16 Domain_ID A-1 B E Bit Enclosure A-1 Page Code Valid 3-13 Enclosure Services A-1 Byte A-1 Enclosure Services Device A-1 C F Code FCP Command, Information Unit 3-2 Additional Sense 3-16 Additional Sense Code Qualifier 3-16 Sense NO ADDITIONAL SENSE INFORMATION FCP Data Information Unit Command 3-3 FCP Response Information Unit Command 3-3 FCP Transfer Ready Information Unit
P Page Diagnostics 3-5 Fabric 3-7 Fibre Channel Port Table 3-8 Neighborhood Table 3-8 Sensor Table 3-7 Supported Diagnostics 3-5 Switch 3-6 Page Code Valid Bit 3-13 R Receive Diagnostic Results Command 3-13, 3-15 Redundancy A-2 Reject Command 3-16 Report LUNs Command 3-14 Request Sense Command 3-14 S SCSI A-2 SCSI Device A-2 Send Diagnostic Command 3-15 Sense Additional Code Field ASC 3-16 Additional Code Qualifier 3-16 Sense Key 3-16 SilkWorm Fabric Page 3-7 Fibre Channel Port Table Page 3-8 Neighbo
Comment Sheet StorageTek welcomes your comments about this publication. Please complete this form, including your name and address, and mail it to StorageTek, Technical Communications Department, 7600 Boone Avenue North, Minneapolis, Minnesota, 55428-9919, USA. Comments may also be submitted over the Internet by addressing them to: doccomment@network.com Always include the complete publication number and title of the document with your comments.
FOLD 1ST FOLD 1ST NO POSTAGE NECESSARY IF MAILED IN THE UNITED STATES BUSI NESS REPLY MAIL FIRST CLASS MAIL PERMIT NO.
StorageTek Problem Reporting Please direct any product-related problems or complaints to the following toll-free telephone 1-800-248-8777 number: Please be aware that, depending on your maintenance and/or warranty coverage, the services delivered may be chargeable. This form is provided for your convenience in gathering information for your call. Make as many copies as you wish.