ATTO Celerity Fibre Channel Host Adapters Installation and Operation Manual Celerity FC-164E 16Gb FC quad channel PCIe 3.0 host adapter Celerity FC-162E 16Gb FC dual channel PCIe 3.0 host adapter Celerity FC-161E 16Gb FC single channel PCIe 3.0 host adapter Celerity FC-84EN 8Gb FC quad channel PCIe 2.0 host adapter Celerity FC-82EN 8Gb FC dual channel PCIe 2.0 host adapter Celerity FC-81EN 8Gb FC single channel PCIe 2.
ATTO Technology, Inc. 155 CrossPoint Parkway Amherst, New York 14068 USA www.attotech.com Tel Fax (716) 691-1999 (716) 691-9353 Sales support: sls@attotech.com Technical support: Monday -- Friday, 8am-6pm EST techsupp@attotech.com (716) 691-1999 ext. 242 © 2013 ATTO Technology, Inc. All rights reserved. All brand or product names are trademarks of their respective holders. No part of this manual may be reproduced in any form or by any means without the express written permission of ATTO Technology, Inc.
Contents 1 ATTO Celerity HBA Features & Overview ........................................................1 Getting started Celerity FC-164E Adapter Celerity FC-162E Adapter Celerity FC-161E Adapter Celerity FC-84EN Adapter Celerity FC-82EN Adapter Celerity FC-81EN Adapter Celerity FC-44ES Adapter Celerity FC-42ES Adapter Celerity FC-41ES Adapter 2 Install Drivers .....................................................................................................
Appendix E Standards, Compliances: 8Gb adapters ........................................x FCC standards: radio and television interference Canadian standards European standards Appendix F Standards, Compliances: 4Gb adapters ........................................xi FCC standards: radio and television interference Canadian standards European standards Appendix G Safety, Warranty ..............................................................................xii Safety ATTO Technology, Inc.
1 ATTO Celerity HBA Features & Overview The ATTO Celerity Fibre Channel family of storage products provides connectivity, intelligence and scalability. Celerity FC host adapters simplify advanced storage networking needs such as switching, backup and data management. Specifically designed to enhance the functionality of third party fabric hardware and software, Celerity FC products are the industryleading platform for storage connectivity.
Celerity FC-164E Adapter The ATTO Celerity FC-164E leverages two nextgeneration storage technologies: PCIe 3.0 interconnect and 16-Gigabit Fibre Channel. With 16-Gb FC speeds of up to 1600 MB/sec. per channel, the Celerity FC-164E supports the most demanding application requirements, including highdefinition video, rich content databases and other high-bandwidth environments.
Celerity FC-162E Adapter The ATTO Celerity FC-162E leverages two nextgeneration storage technologies: PCIe 3.0 interconnect and 16-Gigabit Fibre Channel. With 16-Gb FC speeds of up to 1600 MB/sec. per channel, the Celerity FC-162E supports the most demanding application requirements, including highdefinition video, rich content databases and other high-bandwidth environments.
Celerity FC-161E Adapter The ATTO Celerity FC-161E leverages two nextgeneration storage technologies: PCIe 3.0 interconnect and 16-Gigabit Fibre Channel. With 16-Gb FC speeds of up to 1600 MB/sec. per channel, the Celerity FC-161E supports the most demanding application requirements, including highdefinition video, rich content databases and other high-bandwidth environments.
Celerity FC-84EN Adapter The ATTO Celerity FC-84EN leverages two nextgeneration storage technologies: PCIe 2.0 interconnect and 8-Gigabit Fibre Channel. With 8-Gb FC speeds of up to 1600 MB/sec. per channel, the Celerity FC-84EN supports the most demanding application requirements, including highdefinition video, rich content databases and other high-bandwidth environments.
Celerity FC-82EN Adapter The ATTO Celerity FC-82EN leverages two nextgeneration storage technologies: PCIe 2.0 interconnect and 8-Gigabit Fibre Channel. With 8-Gb FC speeds of up to 1600 MB/sec. per channel, the Celerity FC-82EN supports the most demanding application requirements, including highdefinition video, rich content databases and other high-bandwidth environments.
Celerity FC-81EN Adapter The ATTO Celerity FC-81EN leverages two nextgeneration storage technologies: PCIe 2.0 interconnect and 8-Gigabit Fibre Channel. With 8-Gb FC speeds of up to 1600 MB/sec. per channel, the Celerity FC-81EN supports the most demanding application requirements, including highdefinition video, rich content databases and other high-bandwidth environments.
Celerity FC-44ES Adapter The Celerity FC-44ES uses PCI Express Interconnect and 4-Gigabit Fibre Channel to provide 4-Gb FC speeds of up to 800 MB/sec. per channel. The FC44ES supports high-definition video, rich content databases and other high bandwidth environments. The FC-44ES uses PCI Express, a serial, high-speed connection that supports aggregate throughput up to 4 GB/sec. (x8 PCIe) full-duplex.
Celerity FC-42ES Adapter The Celerity FC-42ES is a dual-channel host adapter providing port density for Enterprise server and workstation applications. With 4-Gb FC speeds of up to 800 MB/sec. per channel, the FC-42ES supports the most demanding application requirements. Additionally the FC-42ES uses the latest in host interconnect technology, PCI Express, a serial, highspeed connection that supports aggregate throughput up to 4 GB/sec. (x8 PCIe) full-duplex.
Celerity FC-41ES Adapter The Celerity FC-41ES is a single-channel host adapter providing support for the most demanding application requirements. With 4-Gb FC speeds of up to 800 MB/sec. per channel, the FC-41ES is a cost effective connectivity solution for environments requiring maximum throughput. The FC-41ES uses the latest in host interconnect technology: PCI Express, a serial, high-speed connection that supports aggregate throughput up to 2 GB/sec. (x4 PCIe) full-duplex.
Selection guide: Celerity 16-Gb adapters Product Features Fibre Channel Ports FC protocol Maximum Transfer Rate (full duplex) Bus type Bus characteristics Optical interface Maximum cable length (OM2 type cable) FC-164E Software RAID support1 Developer's kit (Target Mode & API) Windows support Linux driver support 4 2 1 16-Gb 16-Gb 6400 MB/sec 3200 MB/sec 1600 MB/sec. PCIe 3.0 PCIe 3.0 PCIe 3.
Selection guide: Celerity 4-Gb adapters Product Features Fibre Channel Ports FC-44ES FC-42ES FC-41ES 4 2 1 4-Gb 4-Gb 4-Gb Maximum Transfer Rate (half duplex) 1.6 GB/sec 800 MB/sec 400 MB/sec. Maximum Transfer Rate (full duplex) 2 GB/sec 1 GB/sec 800 MB/sec.
2 Install Drivers Before installing your Celerity adapter, you must configure your system to recognize and use it by installing drivers for your operating system. Configure your system to recognize and use your Celerity adapter by installing drivers for your operating system. Note If you already have one or more Celerity adapters installed and you are installing additional adapter(s), you do not need to perform any of these procedures unless you are updating a previously installed driver.
Creating Windows installation media Note Installation media is required when performing an installation of Windows to a hard drive that is controlled by a Celerity FC host adapter. A floppy is required for Windows 2000, XP or 2003. Windows 8, 7, Vista, Server 2012 and 2008 can utilize other media such as removable USB stick. This procedure does not apply to Itanium systems as the Celerity FC driver does not support boot functionality on these systems.
Adjusting adapter settings with the EFI Configuration Utility (only for 16Gb and 8Gb FC adapters) Note Depending on your configuration, it may be necessary to adjust adapter NVRAM settings prior to performing the OS X installation. For example, you may need to modify the connection mode or data rate. The EFI configuration utility can be launched from the EFI shell. Note An EFI shell is not included with Intel Macs. ATTO recommends rEFIt, which is available for free from http://refit.sourceforge.net.
Installing OS X Leopard or Tiger onto a disk attached to a Celerity adapter (only for 16Gb and 8Gb FC adapters) Models: 162E, 161E, 84EN, 82EN, 81EN Note Due to limitations of the Mac OS X Installer, two systems are required to complete this procedure. These will be referred to as the “target” and “host” systems. The target system will contain your Celerity adapter and storage.
VMware ESXi 5 Including driver in boot image 2 Note 8Gb and 16Gb Celerity support. VMware vSphere 5 includes the ability to dynamically construct boot images for your ESXi 5 servers using vCenter 5. This allows you to include ATTO drivers as part of a boot image, then using PXE boot you can start an ESXi 5 host with that image. The end result is that your server(s) will boot and have ATTO drivers included without any additional steps.
4 Log in to the ESX/ESXi host on the Service Console (ESX) or the Local Tech Support Console (ESXi), or through an SSH client. 5 Install the offline bundle using the following command on the ESX/ESXi host: # esxupdate --maintenancemode --nosigcheck update --bundle 6 Once the package is installed, reboot the ESX/ESXi host. For detailed instructions or driver parameters, please reference the Supplemental Guide for VMware ESX/ESXi on page 33. VMware ESX 3.5 a.
6 7 8 Remove the driver CD from the CD-ROM drive before the system reboots. After the system reboots, log in to ESX Server. Verify that the driver is installed successfully: a. Run the esxupdate query command and verify that the information about the driver is mentioned in the resulting message. b. View the PCI ID XML file in the /etc/vmware/pciid/ directory. The driver information is available in the file. c. Check for the latest version of the driver module in /usr/lib/vmware/vmkmod/ d.
3 Hardware Installation You need a basic understanding of Fibre Channel before installing the Celerity FC host adapter. Please refer to Appendix A for a list of related websites. CAUTION Installation CAUTION Back up your system data before changing or installing any hardware. Celerity FC host adapters contain components that are sensitive to electrostatic discharge (ESD). ESD can cause damage to the Celerity FC host adapter. Please follow standard methods to avoid ESD.
Bracket details Exhibit 3-1 FC-164E Exhibit 3-2 FC-162E Exhibit 3-3 FC-161E 21
Exhibit 3-4 FC-84EN Exhibit 3-5 FC-82EN full height and low profile Exhibit 3-6 FC-81EN full height and low profile 22 ATTO Technology Inc.
Exhibit 3-7 FC-44ES full height Exhibit 3-8 FC-42ES low profile, full height Exhibit 3-9 FC-41ES low profile and full height 23
Adapter board details Exhibit 3-10 FC-164E Exhibit 3-11 FC-162E 24 ATTO Technology Inc.
Exhibit 3-12 FC-161E Exhibit 3-13 FC-84EN 25
Exhibit 3-14 FC-82EN Exhibit 3-15 FC-81EN 26 ATTO Technology Inc.
Exhibit 3-16 FC-44ES Exhibit 3-17 FC-42ES FC controller SFP LC optical connectors PCIe connector 27
Exhibit 3-18 FC-41ES FC controller SFP LC optical connector PCIe connector 28 ATTO Technology Inc.
4 Updating Hardware Flash, Drivers Your Celerity FC host adapter is shipped with the latest flash and drivers but these may need to be updated as new versions become available. Visit the ATTO website, www.attotech.com, to download the latest drivers and flash bundle. Updating flash Updating drivers Hardware flash memory may need to be updated as new versions become available. Update drivers by downloading the latest driver software from the ATTO Technology website.
9 After the download has completed, process the downloaded file: • On OS X, mount the .dmg file, then double click on the installer icon located in the new volume. • On Windows, run the downloaded .exe file. • On Linux, expand the .tgz file, then run the .bin installer application. 10 Follow the instructions for installing the application. 11 To use the tool, refer to the ATTO Utilities Installation and Operation Manual which may be downloaded from the ATTO website. a. Go to www.attotech.com. b.
5 Troubleshooting This chapter contains solutions for the most common problems you might encounter. If you need additional assistance, please refer to the ATTO Technology website, www.attotech.com, or contact an authorized ATTO Technology representative. General suggestions • • • Check each cable connection on every device. Verify all cables are in proper working condition. Loose or broken cables are often the cause of errors or problems.
• Procedures vary greatly: refer to the manual supplied with your system or call the computer supplier for configuration assistance. • Windows 8/7/Vista/XP/Server 2012/2008/2003/2000 are Plug-n-Play operating systems: be sure your computer’s BIOS is set accordingly. • If these do not solve the problem, re-flash the host adapter and re-install the Windows 2000/XP/Server 2003/Vista/2008 driver. See Updating Hardware Flash, Drivers on page 29.
Supplemental Guide for VMware ESX/ESXi The following information should be used by advanced users only. Please consult with our Technical Support Department before applying any of the following information. 1 Driver Configuration To list the driver parameters that have been set: Use the esxcfg-module command to query and configure the ATTO adapter driver parameters. In the examples that follow, should be replaced with the ATTO driver name.
num_imq num_sas_addr num_sest num_sg_lists num_targets old_device_reset port_retry_count private_els_timeout quick_init sg_tablesize sgl_page_size speed_override topology_override use_tm_completions use_transport_layer Incoming Message Queue entries. These are used to report completion of I/O requests and to notify the host driver of certain other kinds of events detected by the hardware. Default is 256. Number of SAS addresses to assign to the adapter’s PHYs.
2 Adapter Management On VMware ESX/ESXi you can identify and manage ATTO adapters using the VMware vSphere Client, or the Service Console. On ESXi, the Service Console is referred to as Local Tech Support Mode. 2.1 vSphere Client With VMware vSphere Client, you can identify ATTO adapters on a VMware ESX/ESXi system, and view the attached storage devices. 1 2 3 Start vSphere Client from your local workstation and select the host containing one or more ATTO adapters.
Virtual Ports (NPIV) N_Port ID Virtualization (NPIV) is an extension to the Fibre Channel industry standard. NPIV allows a single, physical adapter port to function as multiple virtual ports (VPorts), each having a unique Fibre Channel World-Wide-Name in the SAN. This allows a Storage Administrator to follow SAN best practices, such as zoning and masking, to control LUN access on a per-VPort basis.
2 VMware ESX/EXi The 8Gb and 16Gb Celerity drivers for VMware ESX/ESXI 4.x and VMware ESXI 5.x provide NPIV support by default (the functionality does not have to max_npiv_logins max_npiv_vports npiv_disc_wait_time npiv_init_retries be explicitly enabled). However, there are four driver parameters that affect the performance and behavior of the NPIV feature, they are as follows: The maximum number of target ports that can be logged into a virtual port. Default is 32; maximum is 256.
Appendix A Glossary Some terms used in the Fibre Channel industry are defined below. More information is available through the ATTO Technology website (www.attotech.com), the Fibre Channel Industry Association (www.fibrechannel.com), Cern (www.cern.ch), the Storage Area Networking Industry Association (www.snia.org), and the Fibre Channel Consortium (www.iol.unh.edu/consortiums, click on FC).
Term Definition N_port NL_ port originator parity checking a port attached to a node used with point to point or fabric configurations a port attached to a node in Fibre Channel arbitrated loop or fabric loop configuration an initiating device; a component which originates a command a method which verifies the accuracy of data transmitted over the SCSI bus by adding one bit in the transfer to make the sum of all the bits either odd or even (for odd or even parity); an error message occurs if the sum is n
Appendix B Accessories The following Fibre Channel accessories are available through ATTO Technology and authorized resellers. Contact an ATTO Technology authorized sales representative to order.
Appendix C ATTO Adapter Selection Guides Contact your ATTO representative or visit the ATTO website for details on all ATTO products. ExpressPCI SCSI host adapters Ultra 320 SCSI Product Features UL5D UL5D LP UL4D 640 640 640 • • • • • • 2/2 30 0/2 30 2/2 30 Large file transfers • • • • Cable distances (m) 12.5 12.5 12.5 Max. transfer rate (MB/sec.
ExpressSAS 6 Gb Host adapters Product Features Max Data Rate x8 PCI Express Number of ports Port configuration external/internal Connector type Number of devices supported 1.5 Gb SATA support 3 Gb SATA II support 3 Gb SAS support 6 Gb SATA II support 6 Gb SAS support Software RAID Cable distances Advanced Data Streaming™ 32-bit support 64-bit support Windows Linux Mac OS X VMware Low profile H6F0 H60F H680 H608 H644 6 Gb/sec. • 16 6 Gb/sec. • 16 6 Gb/sec. • 8 6 Gb/sec. • 8 6 Gb/sec.
ExpressSAS 6 Gb RAID adapters Product Features Max Data Rate x8 PCI Express Number of ports Port configuration external/internal Connector type R60F R680 R608 R644 6 Gb/sec. • 16 6 Gb/sec. • 8 6 Gb/sec. • 8 6 Gb/sec.
FastFrame SFP+ Network Interface Cards Product Features Max Data Rate x8 PCI Express Number of ports Connector type Advanced Data Streaming™ 32-bit support 64-bit support Windows Linux Mac OS X Low profile NS14 NS12 NS11 10 Gb/sec. • 4 LC Fibre Optic 10 Gb/sec. • 2 LC Fibre Optic 10 Gb/sec.
FastFrame SFP+ Converged Network Adapters Product Features Max Data Rate x8 PCI Express Number of ports Connector type Advanced Data Streaming™ FCoE Support 32-bit support 64-bit support Windows Linux Mac OS X Low profile CS14 CS12 CS11 10 Gb/sec. • 4 LC Fibre Optic 10 Gb/sec. • 2 LC Fibre Optic 10 Gb/sec.
Appendix D Standards, Compliances: 16Gb adapters The Technical Specification sheet for each Celerity FC host adapter lists certifications for that model. Models covered by this page include the Celerity FC-164E, FC-162E and FC-161E. FCC standards: radio and television interference This equipment has been tested and found to comply with the limits for a Class B digital device, pursuant to Part 15 of the FCC Rules.
Appendix E Standards, Compliances: 8Gb adapters The Technical Specification sheet for each Celerity FC host adapter lists certifications for that model. Models covered by this page include the Celerity FC-84EN, FC-82EN and FC-81EN. FCC standards: radio and television interference This equipment has been tested and found to comply with the limits for a Class B digital device, pursuant to Part 15 of the FCC Rules.
Appendix F Standards, Compliances: 4Gb adapters The Technical Specification sheet for each Celerity FC host adapter lists certifications for that model. Models covered by this page include the Celerity FC-44ES, FC-42ES, FC-41ES and FC-41XS. FCC standards: radio and television interference This equipment has been tested and found to comply with the limits for a Class B digital device, pursuant to Part 15 of the FCC Rules.
Appendix G Safety, Warranty All ATTO host adapter products have been tested to meet applicable safety standards when operated in proper electrical and thermal environments. Safety Please review the specifications for your specific host adapter before installing and operating it in any computer system to ensure compatibility.
ATTO IS NOT RESPONSIBLE FOR DAMAGE TO OR LOSS OF ANY DATA, PROGRAMS OR ANY MEDIA. THE PRODUCTS ARE NOT INTENDED FOR USE IN: (I) MEDICAL DEVICES OR THE MEDICAL FIELD; OR (II) USE IN RUGGED APPLICATIONS. ATTO IS NOT LIABLE FOR ANY INDIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES, IRRESPECTIVE OF WHETHER ATTO HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. NO ATTO DEALER, AGENT OR EMPLOYEE IS AUTHORIZED TO MAKE ANY MODIFICATION, EXTENSION OR ADDITION TO THIS WARRANTY.