HP IO Accelerator 3.2.3 Solaris User Guide Abstract This document describes software requirements for all relevant HP IO Accelerators using Linux operating systems. This document is intended for system administrators who plan to install and use HP IO Accelerators with a Linux operating system. It is helpful to have previous experience with HP IO Accelerators and a Linux operating system. This user guide is intended for IO Accelerator software release 3.2.3 or later.
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein. Confidential computer software.
Contents About this guide ........................................................................................................................... 5 Contents summary ..................................................................................................................................... 5 Introduction .................................................................................................................................. 6 Overview ...................................................
fio-status ................................................................................................................................................. 26 fio-sure-erase .......................................................................................................................................... 28 fio-update-iodrive .................................................................................................................................... 30 Monitoring IO Accelerator health ......
About this guide Contents summary • Instructions on downloading and installing the approved driver and utilities • Instructions on maintaining the IO Accelerator • Description of the following IO Accelerator models: o HP IO Accelerator for BladeSystem c-Class o HP PCIe IO Accelerator o HP PCIe IO Accelerator Duo CAUTION: Before upgrading to 3.x.x software and firmware, back up all data on the IO Accelerator. The 3.2.
Introduction Overview Designed around ioMemory, a revolutionary storage architecture, HP IO Accelerator is an advanced NAND flash storage device. With performance comparable to DRAM and storage capacity on par with hard disks, the IO Accelerator increases performance so that every server can contain internal storage that exceeds the I/O performance of an enterprise SAN. HP IO Accelerator is the first data accelerator designed specifically to improve the bandwidth for I/O-bound applications.
• QK762A: HP 785 GB IO MLC Accelerator for BladeSystem c-Class • QK763A: HP 1.2 TB IO MLC Accelerator for BladeSystem c-Class IMPORTANT: Generation 2 IO accelerators for BladeSystem c-Class are only compatible with Gen8 and later server blades.
NOTE: MSI was disabled to obtain these statistics. Required operating environment The HP IO Accelerator with software 3.2.3 is supported for use in the following operating environments: • Red Hat Enterprise Linux 5 (AMD64/EM64T) • Red Hat Enterprise Linux 6 (AMD64/EM64T) • SUSE LINUX Enterprise Server 10 (AMD64/EM64T) • SUSE LINUX Enterprise Server 11 (AMD64/EM64T) CAUTION: Version 3.1.0 or greater of the driver software is not backward-compatible with any previous driver version.
BladeSystem c-Class IO Accelerators have two distinct designs for the respective server product lines. The G1 through G7 IO Accelerator adapter is provided in a c-Class Type 1 Mezzanine card form factor. It can be installed in both Type 1 and Type 2 mezzanine slots within the c-Class blade G1 through G7 servers, enabling a total of two cards in a half-height server blade, and three cards in a full-height server blade and up to 6 in a double-high, double-wide server (BL680c).
• Sufficient RAM to operate—The amount of RAM that the driver requires to manage the NAND flash varies according to the block size you select when formatting the device (filesystem format, not low-level format). For a virtual machine using an IO Accelerator directly (using PCI pass-through), consult the user guide for the installed operating system. The following table lists the amount of RAM required per 100GB of storage space, using various block sizes. The amount of RAM used in driver version 3.
Software installation Installation overview Before continuing with the installation of this software, do the following: 1. Ensure that your operating system is included in the list of supported operating systems contained in the release notes for this release. 2. Before installing the IO Accelerator VSL, make sure you have properly installed the IO Accelerator devices. For more information, see the IO Accelerator hardware installation guide.
Loading the IO Accelerator VSL facility (driver) The driver is installed and automatically loaded during the package installation (pkgadd; see "Installing the software and utilities (on page 11)").
IMPORTANT: The IO Accelerator device might have a minimum firmware label affixed (for example, "MIN FW: XXXXXX"). This label indicates the minimum version of the firmware that is compatible with your device. Enabling PCIe power For PCIe IO Accelerators, if you have installed any dual IO Accelerator devices, such as the HP ioDrive2 Duo, then the device might require additional power than the minimum 25 W provided by PCIe Gen2 slots to properly function.
Maintenance Maintenance tools The IO Accelerator includes software utilities for maintaining the device. You can also install SNMP as a monitoring option. The following are the most common tasks for maintaining your IO Accelerator. You can also use the IO Accelerator Management Tool application to perform firmware upgrades. For more information, see the HP IO Accelerator Management Tool User Guide.
• Enabling full slot power draw—Some PCIe slots provide additional power (often up to 75 W of power). If your PCIe slot is rated to provide at least 55 W, then you can allow the device to draw full power from the PCIe slot by setting a VSL module parameter. For more information on enabling this override parameter, see "Enabling the override parameter (on page 15).
External Power: NOT connected PCIe Power limit threshold: 24.75W Connected ioMemory modules: fct2: SN:1149D0969-1121 fct3: SN:1149D0969-1111 In this example, 1149D0969 is the adapter serial number. If you have multiple IO Accelerator devices installed on your system, use the fio-beacon command to verify where each device is physically located. o 2. Inspect the adapter serial number labels on the IO Accelerator devices to determine the serial numbers.
Although data written to the IO Accelerator device is not lost due to unmanaged shutdowns, important data structures might not have been properly committed to the device. This consistency check repairs these data structures. Disabling the IO Accelerator VSL The driver automatically loads by default when the operating system starts. You can disable IO Accelerator auto-load for diagnostic or troubleshooting purposes. To disable IO Accelerator driver auto-load: 1.
Monitoring and managing devices Introduction to monitoring and managing devices HP provides many tools for managing your IO Accelerator devices. These tools allow you to monitor the devices for errors, warnings, and potential problems.
Example conditions to monitor This section provides examples of conditions you can monitor. It is intended as an introduction and not as a comprehensive reference. These conditions have slightly different names, states, and values, depending on the tool you choose. For example, an SNMP MIB might have a different name than a SMI-S object or an API function. To properly monitor these conditions, you should become familiar with the tool you choose to implement and read the documentation for that tool.
Required actions If the temperature is at or approaching the YELLOW condition, you must increase the cooling for your system. This might include increasing the fan speed, bringing down the ambient temperature, reducing write load, or moving the device to a different slot. Health reserves percentage IO Accelerator devices are highly fault-tolerant storage subsystems with many levels of protection against component failure and the loss nature of solid-state storage.
Performance and tuning Introduction to performance and tuning HP IO Accelerator devices provide high bandwidth and high IOPS and are specifically designed to achieve low latency. As IO Accelerator devices improve in IOPS and low latency, the device performance may be limited by operating system settings and BIOS configuration. To take advantage of the revolutionary performance of IO Accelerator devices, you might have to tune these settings.
Utilities Utilities reference The IO Accelerator installation packages include various command line utilities, installed by default to the /usr/bin file. These utilities provide a number of ways to access, test, and manipulate your device.
Option Description -c Attach only if clean. Quiet: disables the display of the progress bar and percentage. -q fio-beacon Description The fio-beacon utility enables all three LEDs on, to identify the specified IO Accelerator device. IMPORTANT: This utility enables the LEDs on, unless you select the -0 option. Syntax fio-beacon [options] where is the name of the device node (/dev/fctx), where x indicates the card number: 0, 1, 2, and so on.
Collecting fio-read-lebmap /dev/fct0 Collecting fio-read-lebmap -x /dev/stdout/dev/fct0 Collecting fio-read-lebmap -t /dev/fct0 Collecting fio-get-erase-count/dev/fct0 Collecting fio-get-erase-count -b /dev/fct0 Collecting lspci Collecting lspci -vvvvv Collecting lspci -tv Collecting messages file(s) Collecting procfusion file(s) Collecting lsmod Collecting uname -a Collecting hostname Collecting sar -r Collecting sar Collecting sar -A Collecting syslog file(s) Collecting proc file(s) Collecting procirq fil
Syntax fio-detach [options] where is the name of the device node (/dev/fctx), where x indicates the board number: 0, 1, 2, and so on. For example, /dev/fct0 indicates the first IO Accelerator installed on the system. You can specify multiple IO Accelerator devices. For example, /dev/fct1 /dev/fct2 indicates the second and third IO Accelerator devices installed on the system. You can also use a wildcard to indicate all IO Accelerator devices on the system.
Options Description -f Force the format size, bypassing normal checks and warnings. This option may be needed in rare situations when fio-format does not proceed properly. (The "Are you sure?" prompt still appears unless you use the -y option.) This option can only be used with the -o option. -q Quiet mode: Disable the display of the progress-percentage indicator.
Options Description -u Show unavailable fields. Only valid with -fj or -fx. -F Print the value for a single field (For field names, see the next option). Requires that a device be specified. Multiple -F options may be specified. -U Show unavailable fields and details why. Only valid with -fj or -fx. List the fields that can be individually accessed with -F. -l CAUTION: Output Change Starting with version 3.0.0 and later, the standard formatting of fio-status output has changed.
• Manufacturer number • Part number • Date of manufacture • Power loss protection status • PCIe bus voltage (average, minimum, maximum) • PCIe bus current (average, maximum) • PCIe bus power (average, maximum) • PCIe power limit threshold (watts) • PCIe slot available power (watts) • PCIe negotiated link information (lanes and throughput) Block device information: • Manufacturer's code • Manufacturing date • Vendor and sub-vendor information • Format status and sector information
CAUTION: Do not use this utility if there are any IO Accelerator devices installed in the system that are not selected to be cleared or purged of data. • • • • Ensure that you back up any data prior to activation of this utility. Remove any devices that are not targeted for purge. After the data is removed from the target devices, it is purged. There is no recovery to this action. CAUTION: If the device is in Read-only mode, perform a format using fio-format before running fio-sure-erase.
Clear support A Clear is the default state of running fio-sure-erase (with no options), and refers to the act of performing a full low-level erase (every cell pushed to 1) of the entire NAND media, including retired erase blocks. Metadata that is required for operation will not be destroyed (media event log, erase counts, physical bytes read/written, performance and thermal history), but any user-specific metadata will be destroyed. The following describes the steps taken in the Clear operation: 1.
CAUTION: • During a firmware upgrade, it is critical to maintain steady power or risk failure of the IO Accelerator device. Connecting a qualified UPS is recommended prior to performing a firmware upgrade. • It is critical to load the driver after each firmware upgrade step when scheduling sequential, multiple firmware upgrades (example: 1.2.7 to 2.1.0 to 2.3.1). If the driver is not loaded, the on-drive format will not be changed and there will be data loss.
Options Description -q Runs the update process without displaying the progress bar or percentage. -s Updates the devices in the specified slots using "*" as a wildcard for devices. The slots are identified in the following PCIe format (as shown in lspci): [[[[]:]]:][][.[]] -y Confirm all warning messages. All three external LED indicators light up during the update process.
Monitoring IO Accelerator health NAND flash and component failure The IO Accelerator is a highly fault-tolerant storage subsystem that provides many levels of protection against component failure and the loss nature of solid state storage. However, as in all storage subsystems, component failures might occur. By pro-actively monitoring device age and health, you can ensure reliable performance over the intended product life.
block device, beyond specifying that the mount must be read-only. For example, under Linux, ext3 requires that -o ro, noload is used. The noload option directs the file system not to attempt to replay the journal. Read-only mode must be considered a final opportunity to migrate data off the device since device failure is more likely with continued use. The IO Accelerator might enter failure mode. In this case, the device is offline and inaccessible.
ZFS pools and health monitoring ZFS pools are typically configured to detect and mitigate the failure modes of traditional storage media. The IO Accelerator device attempts to fail as gracefully as possible, and these new failure mechanisms are compatible with ZFS pools. A device in a zpool fails to receive data at a sufficient rate if the device is in a write-reduced state and it is participating in a write-heavy workload. In this case, the drive is evicted from the zpool.
Upgrading devices Upgrading devices for IO Accelerator VSL 2.x.x to 3.x.x This version of IO Accelerator VSL software supports new features, including the latest generation of IO Accelerator architecture and improved Flashback protection. These features require the latest version of the IO Accelerator firmware. Every device in a system running 2.x or later must be upgraded to the latest version of the firmware. For example, if you have a system running 2.x.
b. Run the fio-bugreport command-line utility and save the output. This output captures the device information for each device in the system. This device information will be useful in troubleshooting any upgrade issues. For example: fio-bugreport c. Detach the IO Accelerator devices. For example: fio-detach /dev/fct* For more information, see "fio-detach (on page 24)." 2. 3. 4. Unload the current IO Accelerator driver. For example: $ pfexec rem_drv iomemory-vsl Uninstall the 2.
10. Using the following command, check the status of all devices: fio-status -a Your IO Accelerator devices are now successfully upgraded for this version of the HP IO Accelerator. You can now install any IO Accelerator Gen2 devices.
Resources Subscription service HP recommends that you register your product at the Subscriber’s Choice for Business website (http://www.hp.com/support). After registering, you will receive e-mail notification of product enhancements, new driver versions, firmware updates, and other product resources. For more information For additional information, see the following HP websites: • HP BladeSystem technical resources (http://www.hp.
Support and other resources Before you contact HP Be sure to have the following information available before you call HP: • Active Health System log (HP ProLiant Gen8 or later products) Download and have available an Active Health System log for 3 days before the failure was detected. For more information, see the HP iLO 4 User Guide or HP Intelligent Provisioning User Guide on the HP website (http://www.hp.com/go/ilo/docs).
providers or service partners) identifies that the repair can be accomplished by the use of a CSR part, HP will ship that part directly to you for replacement. There are two categories of CSR parts: • Mandatory—Parts for which customer self repair is mandatory. If you request HP to replace these parts, you will be charged for the travel and labor costs of this service. • Optional—Parts for which customer self repair is optional. These parts are also designed for customer self repair.
Pour plus d'informations sur le programme CSR de HP, contactez votre Mainteneur Agrée local. Pour plus d'informations sur ce programme en Amérique du Nord, consultez le site Web HP (http://www.hp.com/go/selfrepair). Riparazione da parte del cliente Per abbreviare i tempi di riparazione e garantire una maggiore flessibilità nella sostituzione di parti difettose, i prodotti HP sono realizzati con numerosi componenti che possono essere riparati direttamente dal cliente (CSR, Customer Self Repair).
HINWEIS: Einige Teile sind nicht für Customer Self Repair ausgelegt. Um den Garantieanspruch des Kunden zu erfüllen, muss das Teil von einem HP Servicepartner ersetzt werden. Im illustrierten Teilekatalog sind diese Teile mit „No“ bzw. „Nein“ gekennzeichnet. CSR-Teile werden abhängig von der Verfügbarkeit und vom Lieferziel am folgenden Geschäftstag geliefert. Für bestimmte Standorte ist eine Lieferung am selben Tag oder innerhalb von vier Stunden gegen einen Aufpreis verfügbar.
sustituciones que lleve a cabo el cliente, HP se hará cargo de todos los gastos de envío y devolución de componentes y escogerá la empresa de transporte que se utilice para dicho servicio. Para obtener más información acerca del programa de Reparaciones del propio cliente de HP, póngase en contacto con su proveedor de servicios local. Si está interesado en el programa para Norteamérica, visite la página web de HP siguiente (http://www.hp.com/go/selfrepair).
Opcional – Peças cujo reparo feito pelo cliente é opcional. Essas peças também são projetadas para o reparo feito pelo cliente. No entanto, se desejar que a HP as substitua, pode haver ou não a cobrança de taxa adicional, dependendo do tipo de serviço de garantia destinado ao produto. OBSERVAÇÃO: Algumas peças da HP não são projetadas para o reparo feito pelo cliente. A fim de cumprir a garantia do cliente, a HP exige que um técnico autorizado substitua a peça.
Support and other resources 46
Support and other resources 47
Acronyms and abbreviations ACPI Advanced Configuration and Power Interface DVFS dynamic voltage and frequency scaling IOPS input/output operations per second LEB Logical Erase Block LVM Logical Volume Manager MIB management information base NAND Not AND RHEL Red Hat Enterprise Linux RPM Red Hat Package Manager VSL virtual storage layer Acronyms and abbreviations 48
Documentation feedback HP is committed to providing documentation that meets your needs. To help us improve the documentation, send any errors, suggestions, or comments to Documentation Feedback (mailto:docsfeedback@hp.com). Include the document title and part number, version number, or the URL when submitting your feedback.
Index A about this guide 5 authorized reseller 43, 44 C command-line utilities 15 configuring a ZFS pool 13 contents summary 5 CSR (customer self repair) 44 customer self repair (CSR) 44 D devices, upgrading 39 disabling auto attach 17 disabling DVFS 23 disabling the driver 18 documentation feedback 53 E Enabling PCIe power 13 enabling PCIe power override 15 enabling the driver 18 enabling the override parameter 16 HP Subscriber's Choice for Business 42 HP technical support 43, 44 HP, contacting 44 I i
R resources 42, 43 S software installation 11 support 43, 44 support and other resources 43 supported firmware revisions 8 supported hardware 9 T technical support 43, 44 telephone numbers 43, 44 U uninstalling the driver 17 unmanaged shutdown issues 18 upgrading devices 39 upgrading firmware 12 upgrading, procedure 39 using module parameters 38 using the IO Accelerator as a swap 13 utilities 11, 25 utilities reference 25 W website, HP 44 Z ZFS pool, configuring 13 ZFS pools 38 Index 51
