USER’S GUIDE Integrated RAID for SAS April 2007 Version 1.
Proprietary Rights Notice This document contains proprietary information of LSI Logic Corporation. The information contained herein is not to be used by or disclosed to third parties without the express written permission of an officer of LSI Logic Corporation. Document Description Document DB15-000357-01, Version 1.
Copyright Notice Copyright © 2006, 2007 by LSI Logic Corporation. All rights reserved. Trademark Acknowledgments LSI Logic, the LSI Logic logo design, Fusion-MPT, Integrated Mirroring, and Integrated Striping are trademarks or registered trademarks of LSI Logic Corporation. Windows and Windows NT are registered trademarks of Microsoft Corporation. All other brand and product names may be trademarks of their respective companies.
iv Version 1.1 Copyright © 2006, 2007 by LSI Logic Corporation. All rights reserved.
Preface This user’s guide explains how to configure and use the components of the LSI Integrated RAID (IR) software product with LSI SAS controllers. Audience This user’s guide assumes that you have some familiarity with installing and configuring software programs and that you are familiar with computer storage devices in general.
• Chapter 4, Overview of Integrated Striping, provides an overview of the LSI Integrated Striping™ (IS) feature. • Chapter 5, Creating Integrated Striping Volumes, describes how to configure Integrated Striping (IS) volumes with the BIOS-based configuration utility. • Appendix A, Using the CFGGEN IR Configuration Utility, describes how to create IM, IME, and IS volumes using the CFGGEN IR configuration utility (for manufacturing use only).
Contents Chapter 1 Introduction to Integrated RAID 1.1 Introduction 1.2 Integrated RAID Benefits and Features 1.3 Using this Manual 1-1 1-2 1-3 Chapter 2 Overview of Integrated Mirroring and Integrated Mirroring Enhanced 2.1 Introduction 2.2 IM and IME Features 2.3 IM/IME Description 2.4 Integrated RAID Firmware 2.4.1 Resynchronization with Concurrent Host I/O Operation 2.4.2 Metadata Support 2.4.3 Hot Swapping 2.4.4 SMART Support 2.4.5 Hot Spare Disk 2.4.6 Media Verification 2.4.7 Disk Write Caching 2.
3.3 3.4 3.5 Creating a Second IM or IME Volume 3-5 Managing Hot Spares 3-6 Other Configuration Tasks 3-8 3.5.1 Viewing Volume Properties 3-8 3.5.2 Synchronizing an Array 3-8 3.5.3 Activating an Array 3-9 3.5.4 Deleting an Array 3-9 3.5.5 Locating a Disk Drive, or Multiple Disk Drives in a Volume 3-10 3.5.6 Selecting a Boot Disk 3-10 Chapter 4 Overview of Integrated Striping 4.1 Introduction 4.2 IS Features 4.3 IS Description 4.4 Integrated Striping Firmware 4.4.1 Metadata Support 4.4.2 SMART Support 4.4.
Appendix A Using the CFGGEN IR Configuration Utility A.1 Hardware and Software Requirements A.2 CFGGEN Interface Description A.3 CFGGEN Commands A.3.1 Common Command Line Parameters A.3.2 CREATE Command A.3.3 DEFAULTS Command A.3.4 DISPLAY Command A.3.5 FORMAT Command A.3.6 HOTSPARE Command A.3.7 STATUS Command A.3.8 SETOFFLINE Command A.3.9 SETONLINE Command A.3.10 AUTO Command (EFI Version Only) A.3.11 DISABLEIR Command (EFI Version Only) A.3.12 ENABLEIR Command (EFI Version Only) A.3.
x Contents Version 1.1 Copyright © 2006, 2007 by LSI Logic Corporation. All rights reserved.
Figures 2.1 2.2 2.3 3.1 3.2 3.3 4.1 4.2 5.1 5.2 Typical Integrated Mirroring Implementation Integrated Mirroring Volume Integrated Mirroring Enhanced with Three Disks Adapter Properties Screen Create New Array Screen Manage Array Screen Integrated Striping Example Integrated Striping - Logical and Physical Views Adapter Properties Screen Create New Array Screen Contents Version 1.1 2-4 2-4 2-5 3-3 3-4 3-7 4-3 4-3 5-3 5-4 xi Copyright © 2006, 2007 by LSI Logic Corporation. All rights reserved.
xii Contents Version 1.1 Copyright © 2006, 2007 by LSI Logic Corporation. All rights reserved.
Chapter 1 Introduction to Integrated RAID This chapter provides an overview of the LSI Integrated RAID solution for LSI SAS controllers, its features, and its benefits. The chapter includes these sections: • Section 1.1, “Introduction,” page 1-1 • Section 1.2, “Integrated RAID Benefits and Features,” page 1-2 • Section 1.3, “Using this Manual,” page 1-3 You can use the LSI Integrated RAID solution with the following LSI SAS controllers: 1.
By simplifying the configuration options and by providing firmware support in its host adapters, LSI can offer the Integrated RAID solution at a lower cost than a hardware RAID implementation. Fusion-MPT™ firmware supports IM, IME, and IS volumes. You can create up to two Integrated RAID storage volumes on the same LSI SAS controller. 1.
1.3 Using this Manual • Chapters 2 and 3 of this User’s Guide list IM/IME features and explain how to create IM/IME volumes and optional hot spare disks. • Chapters 4 and 5 list Integrated Striping features and explain how to create Integrated Striping (IS) volumes. • Appendix A explains how to use the CFGGEN IR configuration utility to create IM, IME, and IS volumes in the manufacturing environment. Using this Manual Version 1.1 1-3 Copyright © 2006, 2007 by LSI Logic Corporation.
1-4 Introduction to Integrated RAID Version 1.1 Copyright © 2006, 2007 by LSI Logic Corporation. All rights reserved.
Chapter 2 Overview of Integrated Mirroring and Integrated Mirroring Enhanced This chapter provides an overview of the LSI Integrated Mirroring (IM) and Integrated Mirroring Enhanced (IME) features. It includes these sections: 2.1 • Section 2.1, “Introduction,” page 2-1 • Section 2.2, “IM and IME Features,” page 2-2 • Section 2.3, “IM/IME Description,” page 2-3 • Section 2.4, “Integrated RAID Firmware,” page 2-5 • Section 2.
controller can have one or two global hot spare disks available to automatically replace a failed disk in the IM or IME storage volumes on the controller. Hot spares make the IM/IME volume even more faulttolerant. Note: You can also configure one IM or IME volume and one Integrated Striping (IS) volume on the same LSI SAS controller. The IM/IME feature uses the same device drivers as the standard LSI Fusion-MPT based controllers, providing seamless and transparent fault tolerance.
2.3 • Fusion-MPT architecture. • Easy-to-use BIOS-based configuration utility. • Error notification: the drivers update an OS-specific event log. • SES status LED support. • Write journaling, which allows automatic synchronization of potentially inconsistent data after unexpected power-down situations. • Metadata used to store volume configuration on mirrored disks. • Automatic background resynchronization while host I/Os continue.
Figure 2.1 Typical Integrated Mirroring Implementation IM Volume Primary Mirror SAS NVSRAM (For Write Journaling) LSI Fusion-MPT Controller Memory Bus FLASH (For Configuration) The advantage of an IM/IME volume is that there is always a second, mirrored copy of the data. The disadvantage is that writes take longer because data must be written twice. On the other hand, performance is actually improved during reads. Figure 2.2 shows the logical view and physical view of an IM volume. Figure 2.
Figure 2.
order to verify the configuration. The usable disk space for each member disk is adjusted down when the configuration is created, in order to leave room for this data. 2.4.3 Hot Swapping The firmware supports hot swapping. The hot-swapped disk is automatically resynchronized in the background, without any host or user intervention. The firmware detects hot swap removal and disk insertion.
2.4.6 Media Verification The firmware supports a background media verification feature that runs at regular intervals when the IM/IME volume is in optimal state. If the verification command fails for any reason, the other disk’s data for this segment is read and written to the failing disk in an attempt to refresh the data.
2-8 Overview of Integrated Mirroring and Integrated Mirroring Enhanced Version 1.1 Copyright © 2006, 2007 by LSI Logic Corporation. All rights reserved.
Chapter 3 Creating IM and IME Volumes This chapter explains how to create Integrated Mirroring (IM) and Integrated Mirroring Enhanced (IME) volumes using the LSI SAS BIOS Configuration Utility (SAS BIOS CU). The chapter includes these topics: 3.1 • Section 3.1, “IM/IME Configuration Overview,” page 3-1 • Section 3.2, “Creating IM and IME Volumes,” page 3-2 • Section 3.3, “Creating a Second IM or IME Volume,” page 3-5 • Section 3.4, “Managing Hot Spares,” page 3-6 • Section 3.
3.2 Creating IM and IME Volumes The SAS BIOS CU is part of the Fusion-MPT BIOS. When the BIOS loads during boot and you see the message about the LSI Configuration Utility, press Ctrl-C to start the CU. After you do this, the message changes to: Please wait, invoking SAS Configuration Utility... After a brief pause, the main menu of the SAS BIOS CU appears.
3.2.1 Creating an IM Volume Follow these steps to create an IM volume with the SAS BIOS CU: 1. On the Adapter List screen, use the arrow keys to select an LSI SAS adapter. 2. Press Enter to go to the Adapter Properties screen, shown in Figure 3.1. Figure 3.1 Adapter Properties Screen LSI Logic MPT Setup Utility Adapter Properties -- SAS1068 vx.xx.xx.xx Adapter PCI Slot PCI Address(Bus/Dev/Func) MPT Firmware Revision SAS Address Status Boot Order Boot Support SAS1068 03 03:00:00 00.03.23.
6. Press M to keep the existing data on the first disk or press D to overwrite it. If you keep the existing data, this is called a data migration. The first disk will be mirrored onto the second disk, so any data you want to keep must be on the first disk selected for the volume. Data on the second disk is overwritten. The first disk must have 512-KB available for metadata after the last partition. As disks are added the Array Size field changes to reflect the size of the new volume. 7.
3.2.2 Creating an IME Volume Follow these steps to create an IME volume with the SAS BIOS CU: 1. On the Adapter List screen, use the arrow keys to select an LSI SAS adapter. 2. Press Enter to go to the Adapter Properties screen, shown in Figure 3.1. 3. On the Adapter Properties screen, use the arrow keys to select RAID Properties on the screen and press Enter. 4. When you are prompted to select a volume type, select Create IME Volume.
1. In the configuration utility, select an adapter from the Adapter List. Select the RAID Properties option. This will display the current volume. 2. Press C to create a new volume. 3. Continue with step 4 of Section 3.2.1, “Creating an IM Volume” or step 4 of Section 3.2.2, “Creating an IME Volume” to create a second volume. The other way to add a second volume is as follows: 1. On the Adapter List screen, use the arrow keys to select an LSI SAS adapter. 2.
Figure 3.3 Manage Array Screen LSI Logic MPT Setup Utility Manage Array -- SAS1068 Identifier Type Scan Order Size(MB) Status vx.xx.xx.xx LSILOGICLogical Volume IM 1 34332 Optimal 3000 Manage Hot Spare Synchronize Array Activate Array Delete Array Esc = Exit Menu F1/Shift+1 = Help Enter = Choose array type to create Esc = Return to Adapter Properties 3. Select a disk from the list by pressing the + key, − key, or space bar. 4. After you select the global hot spare disk, press C.
2. Select Delete Hot Spare and then press C. If there are two hot spares, select which one you want to delete. 3. Select Save changes then exit this menu to commit the changes. The configuration utility pauses while the global hot spare is being removed. 3.5 Other Configuration Tasks This section explains how to perform other configuration and maintenance tasks for IM and IME volumes. 3.5.1 Viewing Volume Properties Follow these steps to view the properties of volumes: 1.
Follow these steps to force the synchronization of a selected array: 1. Select Synchronize Array on the Manage Array screen. 2. Press Y to start the synchronization, or N to cancel it. 3.5.3 Activating an Array An array can become inactive if, for example, it is removed from one controller or computer and moved to another one. The Activate Array option allows you to reactivate an inactive array that has been added to a system. This option is only available when the selected array is currently inactive.
Note: 3.5.5 After a volume has been deleted, it cannot be recovered. When an IM volume is deleted, the data is preserved on the primary disk. When an IME volume is deleted, the master boot records of all disks are deleted. Locating a Disk Drive, or Multiple Disk Drives in a Volume You can use the SAS BIOS CU to locate and identify a specific physical disk drive by flashing the drive’s LED. You can also use the SAS BIOS CU to flash the LEDs of all the disk drives in a RAID volume.
The current topology is displayed. If the selection of a boot device is supported, the bottom of the screen lists the Alt+B option. This is the key for toggling the boot device. If a device is currently configured as the boot device, the Device Info column on the SAS Topology screen will show the word “Boot.” 3. To select a boot disk, move the cursor to the disk and press Alt+B. 4. To remove the boot designator, move the cursor down to the current boot disk and press Alt+B.
3-12 Creating IM and IME Volumes Version 1.1 Copyright © 2006, 2007 by LSI Logic Corporation. All rights reserved.
Chapter 4 Overview of Integrated Striping This chapter provides an overview of the LSI Integrated Striping (IS) feature. It includes these sections: 4.1 • Section 4.1, “Introduction,” page 4-1 • Section 4.2, “IS Features,” page 4-2 • Section 4.3, “IS Description,” page 4-2 • Section 4.4, “Integrated Striping Firmware,” page 4-4 • Section 4.
4.2 IS Features Integrated Striping supports the following features: • Support for volumes with two to ten disks • Support for two IS volumes (or one IS volume and one IM/IME volume) on a controller, with up to 12 disks total. (Requires Integrated RAID firmware v1.20.00 or above.) Note: 4.3 All physical disks in a volume must be connected to the same SAS controller.
Figure 4.1 Integrated Striping Example LSI Fusion-MPT Controller SAS Disk 1 Disk 2 Disk 3 Disk 4 Segment 1 Segment 5 Segment 9 Segment 2 Segment 6 Segment 10 Segment 3 Segment 7 Segment 11 Segment 4 Segment 8 Segment 12 Figure 4.2 shows a logical view and a physical view of Integrated Striping configuration. Figure 4.
4.4 Integrated Striping Firmware This section describes features of the LSI Integrated RAID firmware. 4.4.1 Metadata Support The firmware supports metadata, which describes the IS logical drive configuration stored on each member disk. When the firmware is initialized, each member disk is queried to read the stored metadata to verify the configuration. The usable disk space for each IS member disk is adjusted down when the configuration is created, in order to leave room for this data. 4.4.
Chapter 5 Creating Integrated Striping Volumes This chapter explains how to create Integrated Striping (IS) volumes using the LSI SAS BIOS Configuration Utility (SAS BIOS CU). The chapter includes these topics: 5.1 • Section 5.1, “IS Configuration Overview,” page 5-1 • Section 5.2, “Creating IS Volumes,” page 5-2 • Section 5.3, “Creating a Second IS Volume,” page 5-4 • Section 5.
5.2 Creating IS Volumes The SAS BIOS CU is part of the Fusion-MPT BIOS. When the BIOS loads during boot and you see the message about the LSI Configuration Utility, press Ctrl-C to start it. After you do this, the message changes to: Please wait, invoking SAS Configuration Utility... After a brief pause, the main menu of the SAS BIOS CU appears.
Figure 5.1 Adapter Properties Screen LSI Logic MPT Setup Utility Adapter Properties -- SAS1068 vx.xx.xx.xx Adapter PCI Slot PCI Address(Bus/Dev/Func) MPT Firmware Revision SAS Address Status Boot Order Boot Support SAS1068 03 03:00:00 00.03.23.00-IT 500605B0:0000C580 Enabled 1 [Enabled BIOS & OS] RAID Properties SAS Topology Advanced Adapter Properties Esc = Exit Menu Enter = Select Item F1/Shift+1 = Help -/+ = Change Item 3.
Figure 5.2 shows an IS volume configured with two drives. Figure 5.2 Create New Array Screen LSI Logic MPT Setup Utility Create New Array -- SAS1068 vx.xx.xx.
The other way in which to add a second volume is as follows: 1. On the Adapter List screen, use the arrow keys to select an LSI SAS adapter. 2. Press Enter to go to the Adapter Properties screen, shown in Figure 5.1. 3. On the Adapter Properties screen, use the arrow keys to select RAID Properties and press Enter. 4. Continue with step 4 of Section 5.2, “Creating IS Volumes,” to create a second IS volume. 5.
Follow these steps to activate a selected array. 1. Select Activate Array on the Manage Array screen. 2. Press Y to proceed with the activation, or press N to abandon it. After a pause, the array will become active. 5.4.3 Deleting an Array CAUTION: Before deleting an array, be sure to back up all data on the array that you want to keep. Follow these steps to delete a selected array: 1. Select Delete Array on the Manage Array screen. 2. Press Y to delete the array, or press N to abandon the deletion.
Note: 5.4.5 The LEDs on the disk drives will flash as described above if the firmware is correctly configured and the drives or the disk enclosure supports disk location. Selecting a Boot Disk You can select a boot disk in the SAS Topology screen. This disk is then moved to scan ID 0 on the next boot, and remains at this position. This makes it easier to set BIOS boot device options and to keep the boot device constant during device additions and removals. There can be only one boot disk.
5-8 Creating Integrated Striping Volumes Version 1.1 Copyright © 2006, 2007 by LSI Logic Corporation. All rights reserved.
Appendix A Using the CFGGEN IR Configuration Utility This Appendix describes how to use the CFGGEN IR Configuration Utility to create Integrated Mirroring (IM), Integrated Mirroring Enhanced (IME), and Integrated Striping (IS) volumes on LSI SAS controllers. CFGGEN is a command line utility that runs in the DOS, Linux, EFI, and Windows Pre-Installation (WinPE) environments. CFGGEN is a minimally interactive program that can be executed from a command line prompt or a shell script.
A.1 Hardware and Software Requirements The CFGGEN IR Configuration Utility runs on any Intel IA-32 or IA64 compatible platform. It works with storage devices that are compliant with existing SCSI standards. CFGGEN supports the LSISAS1064/1064E, LSISAS1068/1068E, and LSISAS1078 LSI SAS controller chips. CFGGEN runs in the following operating environments: DOS – CFGGEN runs in any environment that is fully DOS compatible and has at least 640-KB of memory.
A.2 CFGGEN Interface Description CFGGEN uses a command line interface. Commands are formatted as follows: cfggen The program name, controller number, command, and parameters fields must be separated by the ASCII space character. The parameter format is command specific, as described in Section A.3, “CFGGEN Commands.
CFGGEN is not case sensitive. You can type CFGGEN commands and parameters in uppercase, lowercase, or a mixture of the two. The following conventions are used in the command descriptions: A.3.1 • Text in italics must be entered exactly as shown on the command line. • Text surrounded by <> must be replaced with a required parameter. • Text surrounded by [ ] may be replaced by an optional parameter.
A.3.2 CREATE Command The CREATE command creates IM, IME, and IS volumes on supported LSI SAS controllers. When a disk drive is added to an IM, IME, or IS volume, its entire storage capacity may or may not be used, depending on drive capacity and volume capacity. For example, if you add a 36-GB disk drive to a volume that only uses 9-GB of capacity on each disk drive, the remaining 27-GB of capacity on the disk drive is unusable.
Parameters – • – Number of the SAS controller targeted by this command. • – Volume type for the new volume to be created. Valid values are IM or IME or IS. • – Size of the RAID volume in megabytes, or MAX for the maximum size available. • Bay – This option indicates that enclosure:bay values are specified instead of SCSI ID values. • – SCSI ID of a hard disk drive to be included in the RAID volume.
Command Line – DOS, Linux, WinPE versions: cfggen defaults [noprompt] EFI version: cfggen delete [noprompt] Parameters – • – Number of the SAS controller targeted by this command. • noprompt – Suppresses display of warnings and prompts. Program Return Value – 0x00 0x01 A.3.4 SUCCESS: command completed successfully. FAILURE: bad command line arguments or operational failure.
Program Return Value – 0x00 0x01 SUCCESS: command completed successfully. FAILURE: bad command line arguments or operational failure. Sample Output – The following example shows a sample output of the CREATE command when used to create an IM configuration.
Size (in MB)/(in sectors) Manufacturer Model Number Firmware Revision Serial No Drive Type Target on SCSI ID 8 Enclosure # Slot # Device is a Hard disk SCSI ID State Size (in MB)/(in sectors) Manufacturer Model Number Firmware Revision Serial No Drive Type Target on SCSI ID 9 Enclosure # Slot # Device is a Hard disk SCSI ID State Size (in MB)/(in sectors) Manufacturer Model Number Firmware Revision Serial No Drive Type Target on SCSI ID 10 Enclosure # Slot # Device is a Hard disk SCSI ID State Size (in MB)/
• Inactive, Okay (OKY) – Volume is inactive and drives are functioning properly. User data is protected if the current RAID level is RAID 1 (IM) or RAID 1E (IME). • Inactive, Degraded (DGD) – Volume is inactive and the user’s data is not fully protected due to a configuration change or drive failure; a data resync or rebuild may be in progress. Physical drive status values are as follows: A.3.5 • Online (ONL) – Drive is operational and is part of a logical drive.
The FORMAT command does not complete and return to a shell prompt until the format operation is complete. This may take a long time for a large disk drive. Command Line – cfggen format [noprompt] cfggen format bay [noprompt] Parameters – • – Number of the controller targeted by this command. • Bay – This option indicates that enclosure:bay values are specified instead of SCSI ID values.
2. CFGGEN does not allow adding a hot spare disk of a type (SAS/SATA) that is different from the disk types in any of the volumes. Command Line – cfggen hotspare cfggen hotspare bay Parameters – • – Number of the SAS controller targeted by this command. • Bay – This option indicates that enclosure:bay values are specified instead of SCSI ID values. • – SCSI ID of the drive targeted by this command.
Program Return Value – 0x00 0x01 SUCCESS: command completed successfully. FAILURE: command failed. Sample Output – Here is an example of the status information returned when a volume resynchronization is in progress: Background command progress status for controller 0...
the disk is still associated with the volume and therefore cannot be addressed by normal I/O requests. If a new disk replaces an offline disk, the new disk is automatically brought online. Otherwise, the disk remains offline until explicitly brought online by SETONLINE command. Command Line – cfggen setoffline Parameters – • – Number of the SAS controller targeted by this command. • – SCSI target ID of the drive targeted by this command.
Program Return Value – 0x00 0x01 SUCCESS: command completed successfully. FAILURE: command failed. A.3.10 AUTO Command (EFI Version Only) The AUTO command, which is currently supported only in the EFI version of CFGGEN, automatically creates an IM, IME, or IS volume. The volume is created with the maximum number of disks available for use in the specified volume type. The main difference from the CREATE command is that with the AUTO command you do not specify SCSI ID values for disks to use in the volume.
6. An IME volume can have three to ten disks, as long as rules 4 and 5 are not violated. An IS volume can have two to ten disks. 7. The the total number of disks combined for two volumes cannot exceed twelve. In addition, one or two hot spare disks can be created per controller, making a maximum of 14 disks supported per controller. (Support for this number of disks requires Integrated RAID firmware v1.20.00 or above.
If there are any existing IM, IME, or IS volumes when this command is run, the user is notified via an output message, no action is taken, and CFGGEN returns FAILURE. If Integrated RAID is already disabled when this command is run, CFGGEN returns SUCCESS. Command Line – cfggen disableir Parameters – • – Number of the SAS controller targeted by this command. Program Return Value – 0x00 0x01 SUCCESS: command completed successfully.
Program Return Value – 0x00 0x01 SUCCESS: command completed successfully. FAILURE: bad command line arguments or operational failure. A.3.13 LIST Command (EFI Version Only) The LIST command, which is currently supported only in the EFI version of CFGGEN, displays a list of all controllers present in the system, along with their corresponding controller #. Command Line – cfggen list Parameters – None Program Return Value – 0x00 0x01 A-18 SUCCESS: command completed successfully.
Customer Feedback We would appreciate your feedback on this document. Please copy the following page, add your comments, and fax it to us at the number shown. If appropriate, please also fax copies of any marked-up pages from this document. Important: Please include your name, phone number, fax number, and company address so that we may contact you directly for clarification or additional information. Thank you for your help in improving the quality of our documents.
Reader’s Comments Fax your comments to: LSI Logic Corporation Technical Publications M/S AF-198 Fax: 408.433.4333 Please tell us how you rate this document: Integrated RAID for SAS User’s Guide. Place a check mark in the appropriate blank for each category.
