IBM System Storage™ Digital Media Storage Solution Installation Guide Selling and Deploying DS3000/DS4000/DS5000 in Apple and StorNext Environments Con Rice Modular Storage Product Specialist LSI Corporation 12007 Sunrise Valley Drive, Suite 325 Reston, VA 20191 Cell: 703-867-0012 Tel: 703-262-5418 e-mail: con.rice@lsi.
Contents INTRODUCTION ....................................................................................................................... 4 File Sharing Environments ..................................................................................................... 4 THREE CURRENT SOLUTIONS .............................................................................................. 5 Apple Homogenous.....................................................................................................
Closing a Case ................................................................................................................. 16 MIGRATING FROM XSAN MDC TO STORNEXT MDC ...................................................... 17 ATTO ....................................................................................................................................... 18 ATTO HBA INSTALLATION ....................................................................................................
INTRODUCTION There has long been a desire to support Apple servers and work stations with IBM DS series storage, and now we have that capability. But due to confusion in the past, we will be approving a very specific set of known, quality configurations. There are two basic aspects of these solutions: One is basic hardware connectivity, the second is the support for file sharing. It‟s important not to confuse the two. Basic hardware connectivity to Apple is supported via RPQ.
THREE CURRENT SOLUTIONS Apple Homogenous Apple Xsan Clients with Linux MDC (Meta Data Controller) (Apple can also be connected without Xsan/StorNext support) Linux Homogenous Linux StorNext Clients with Linux MDC Digital Media Storage Solution Installation Guide © Copyright 2010, IBM Corporation. All rights reserved.
Heterogeneous Apple Xsan Clients, Linux StorNext Clients, Windows Clients (June) and Linux MDC COMPONENT DESCRIPTIONS Apple Clients • Apple connection without StorNext/Xsan support, or • May use Apple Xsan Client software o If you use the Xsan clients and Xsan Meta Data Controller (MDC), then your support comes from Apple. However, if you use the StorNext MDC from Quantum, then Quantum will support the entire solution including the Xsan clients loaded on the Mac‟s.
SAN Architecture must meet RPQ criteria • Limit number of paths for Xsan/StorNext clients to four • This is to limit both complexity and the amount of time required to initialize clients on the SAN • Redundant Meshed Fibre Channel SAN (cross-connected) • RDAC MPP supports this configuration • Some IBM documentation may seem to preclude this, but those documents are based on an old non-“mpp” version of RDAC • Limits cause for failover to Controller failure • Specific Firmware, software, and Operating System
PLANNED SUPPORT ROLLOUT There are very specific capabilities that are being added and they are tied to specific hardware, software, and driver availability. Support will be added in this order: Apple Homogenous Apple Xsan Clients with Linux MDC (Meta Data Controller) (Apple can also be connected without Xsan/StorNext support) 1. Single Host Client connected to DS3000/DS4000/DS5000 Storage (NOW) a. Apple Leopard and Snow Leopard i. Using ATTO HBA‟s and multipathing driver b.
Linux Homogenous Linux StorNext Clients with Linux MDC 3. Multiple Linux Host Client connected to DS3000/DS4000/DS5000 Storage (NOW) a. RHEL/SLES using StorNext Client software i. Using previously supported QLogic and/or Emulex HBA‟s b. With StorNext MDC‟s running on RHEL/SLES i. Using previously supported QLogic and/or Emulex HBA‟s Digital Media Storage Solution Installation Guide © Copyright 2010, IBM Corporation. All rights reserved.
Heterogeneous Apple Xsan Clients, Linux StorNext Clients, Windows Clients (June) and Linux MDC 4. Mixed Host Apple and Linux Client connected to DS3000/DS4000/DS5000 Storage (NOW) a. Apple Leopard and Snow Leopard using Xsan Client software i. Using ATTO HBA‟s and multipathing driver b. RHEL/SLES systems using StorNext CLIENT software i. Using previously supported QLogic and/or Emulex HBA‟s c. With StorNext MDC‟s running on RHEL/SLES i. Using previously supported QLogic and/or Emulex HBA‟s 5.
Planned Future Enhancements Additional Linux HBA choices and Windows Server 200x Meta data Controller 7. Expand RHEL/SLES connectivity choices (Planned) a. Add ATTO HBA‟s for either MDC‟s and/or clients using RDAC MPP i. This step is not tied to any other steps and may occur at any time after step 3 b. Add ATTO HBA‟s for either MDC‟s and/or clients using ATTO multipathing driver i. This step is not tied to any other steps and may occur at any time after step 3 8.
SOLUTION RESTRICTIONS AND RECOMMENDATIONS There are several important aspects to the configuring of the SAN that must be understood. The first is that the SAN design is architected to avoid logical drive failover in the storage subsystem. This is accomplished by employing a meshed fabric where each HBA on the server can see both controllers on the storage subsystem. The second aspect has to deal with access to the shared logical drives.
RECOMMENDED RAID CONFIGURATIONS RAID RAID Array Segment Disk type level size size Journal 1 or 10 As required 256 FC or SAS recommended Meta Data 1 or 10 As required 256 FC or SAS recommended Journal and Meta Data may reside in separate LUN‟s carved from the same RAID Array if required in small implementations. However, the ideal condition is separate LUN‟s tied to separate RAID groups for Journal and Meta Data. If possible, these two LUN‟s should be on a different storage system than the data LUN‟s.
SOLUTION INSTALLATION 1. Use a meshed fabric with each HBA zoned to see both controllers but controllers unable to see each other. 2. Use RDAC or MPIO failover drivers as appropriate for your operating systems (ATTO for Apple). Do not use the StorNext failover driver 3. For Apple Clients a. b. c. d. Set host type LNXCLVMWARE Set TPGS On See script later in this document MAC‟s must use ATTO Celerity FC81-EN, FC82-EN, or FC-84-EN HBA‟s using the 1.3.1b12 driver Atto site http://www.attotech.
10. RAID 1 or 10 for Journal and Meta Data a. Multiple RAID 1 Groups would be preferable to a similarly size RAID 10 b. Placing Meta Data and Journal on a storage system separate from the data is preferable. 11. It is desirable to separate Meta data and Journal LUN‟s and access from the Data LUN‟s. a. In small installations, Meta data, Journal and Data can be different LUN‟s on the same RAID group b. However, it is best to separate MDC and Journal into their own RAID 1 RAID group. c.
QUANTUM / APPLE JOINT PRODUCT SUPPORT PROGRAM Quantum / Apple Joint Product Support Program Overview QUANTUM and Apple have agreed to a cooperative support relationship for QUANTUM‟s StorNext and Apple‟s Xsan products. This means joint customers are assured that both companies will work together to resolve any technical issues with our respective products. Xsan Controlled SAN File System In the case of the joint customer having an Xsan controlled SAN file System, (i.e.
MIGRATING FROM XSAN MDC TO STORNEXT MDC Q. Are there new features in Xsan 2.2 that make it harder to swap out XServe MDCs and replace them with StorNext Linux MDCs? A: “NamedStreams” is the Apple Xsan feature that causes some problems with StorNext. If you don‟t turn it on, you‟re fine. By default, “NamedStreams” is turned on. NamedStreams will make things like the basic StorNext command line copy command, cvcp, not work. Before Xsan 2.2, you could have it copy the “.
ATTO ATTO Technology, Inc. Value Proposition ATTO Technology is a leader in storage and connectivity solutions. In business since 1988, ATTO has maintained a consistent strategy of technical innovation by continually creating new and exciting Host Bus Adapter (HBA) products that are on the leading edge of the storage market. Throughout the years, ATTO has maintained a reputation for providing high-performance products in a variety of storage connectivity technologies for a wide variety of market segments.
Product Features Fibre Channel Ports Maximum Data Rate Maximum Transfer Rate (Full Duplex) Maximum Transfer Rate (Half Duplex) Bus Type Bus Characteristics Optical Interface Maximum Cable Length Low Profile Form Factor Advanced Data Streaming (ADS) Software RAID Support Developers Kit (Target Mode and API) Windows (Server) Windows (work station / client) Linux (Red Hat, SUSE) MAC OSX VMWare ESX RoHS Compliant FC84EN 4 8Gb 6.4 GB/s 3.2 GB/s PCIe 2.
Multipathing is the ability to send I/O over multiple paths to the same LUN Failover and load balancing done on a LUN basis Monitors I/O paths – identifies changes in path status Automatic re-routing of I/O upon detection of an interrupted connection Failover/failback transparent to the OS or application Increase performance by sending data over multiple paths ATTO Config Tool Features Allows simple Setup for the user.
ATTO OS X Configuration Tool Installation Download the latest ATTO Config Tool from www.attotech.com/solutions/ibm Double-click the osx_app_configtool_328.
Viewing multipathing information Launch the ATTO Configuration Tool (double click the Configuration Tool link located in the Applications folder). Expand the tree in the Device Listing window on the left until you see your device (DS System) and virtual disks (LUNs). Paths Tab The Paths tab in the multipathing window displays path information. The information displayed is based on a per Target or per LUN basis, depending on what device is selected to the left of the Configuration Tool.
Path Status at Target Level The icon next to the device indicates the multipathing status for the target (not the LUN): A single path is connected to your device Multiple paths are connected to your device and are functioning normally Multiple paths were connected to your device, but one or more have failed but not all Multiple paths were connected to your device, but all have failed Path Status at LUN Level Path connected to selected LUN is functioning normally Path connected to the selected LUN was worki
Additional Path Information Status – the overall status of all paths. “Online” indicates all paths are connected. “Degraded” indicates one or more paths are not connected. “Offline” indicates all paths have failed Load Balance – load balancing policy chosen (Round Robin, Queue Depth, Pressure) Transfer Count – the total number of bytes transferred on all paths. Target Port – the DS Storage WWPN (World Wide Port Name).
Detailed Info Click on a path in the table to display detailed information for the path in the lower half of the window.
Detailed Statistics Info – Statistics (Shown in Average and Total) – Read Rate / Data Read – Read count in bytes for a particular path – Write Rate / Data Written – Write count in bytes for a particular path – Command Rate / Command Count – Number of commands sent down a particular path – Error Rate / Error Count – Number of errors for a particular path Load Balancing Policies Pressure The path with the fewest bytes will be used This option provides the best performance for the digital video market (large
• Saving the Configuration • When done, select “Finish” • Navigate to the “Paths” menu and choose “Save Configuration” followed by “Yes” when prompted If the connection status for a path changes, the Configuration Tool will automatically refresh the display The Configuration Tool will periodically (~30 seconds) refresh the path statistics for all devices Paths can be manually refreshed by choosing “refresh” in the “Paths” menu Statistics can be reset to „0‟ by choosing “Reset Statistics” in the “Paths” me
***Changes to the adapters NVRAM settings must be changed on each channel of the HBA followed by the commit button and a restart*** Useful OS X Applications TextEdit – Text editor Can be found in: /Applications/TextEdit Disk Utility – OS X disk repair / formatting tool Can be found in: /Applications/Utilities/DiskUtility Console – Allows user to see application logs in real-time Can be found in: /Applications/Utilities/Console Finder – Standard file viewer (similar to Windows Explorer) Terminal – Terminal
APPENDIX: CONFIGURATION SCRIPTS Setting TPGS On This script turns on TPGS for host type LNXCLVMWARE (which is what we are using for OSX).
APPENDIX: EXAMPLE CONFIGURATIONS Large Heterogeneous StorNext configuration MetaData Ethernet Network Linux StorNext Client Apple OSX XSAN Client RHEL or SLES HBA Celerity FC-81EN, FC-82EN, or FC-84EN Driver: .3.1b12 HBA HBA Celerity Celerity FC-81EN, FC-81EN, FC-82EN, FC-82EN, or FC-84EN or FC-84EN Driver: .3.1b12 Driver: .3.
Detailed explanation of example 1. Example Large StorNext configuration showing DS5300‟s with Fibre Channel and/or SATA disk for Data and a separate DS5020 for Meta Data and Journal. These examples are representative only and should not be seen as restrictive. The idea is to use our knowledge of these products to craft solutions with the proper performance and resiliency characteristics to meet customer needs and budget concerns.
Mid to large -sized “MAC Homogenous” StorNext configuration Example 2. In this example diagram Linux MDC Servers are shown, but only MAC Xsan Clients are shown. DS5300 connected to meshed SAN fabric with a minimum of two Fibre Channel switches. For DS5100/DS5300 configurations, a minimum of two switches is recommended. Drawing shows minimal SAN to DS5300 connections to simplify the drawing. However, up to 16 connections is supported.
Mid-sized “MAC Homogenous” StorNext configuration MetaData Ethernet Network Apple OSX XSAN Client Apple OSX XSAN Client HBA HBA Celerity Celerity FC-81EN, FC-81EN, FC-82EN, FC-82EN, or FC-84EN or FC-84EN Driver: .3.1b12 Driver: .3.1b12 HBA Celerity FC-81EN, FC-82EN, or FC-84EN Driver: .3.
Mid-sized “MAC Homogenous” StorNext configuration MetaData Ethernet Network Apple OSX XSAN Client Apple OSX XSAN Client HBA HBA Celerity Celerity FC-81EN, FC-81EN, FC-82EN, FC-82EN, or FC-84EN or FC-84EN Driver: .3.1b12 Driver: .3.1b12 HBA Celerity FC-81EN, FC-82EN, or FC-84EN Driver: .3.
Small “MAC Homogenous” StorNext configuration MetaData Ethernet Network Apple OSX XSAN Client Apple OSX XSAN Client HBA HBA Celerity Celerity FC-81EN, FC-81EN, FC-82EN, FC-82EN, or FC-84EN or FC-84EN Driver: .3.1b12 Driver: .3.1b12 HBA Celerity FC-81EN, FC-82EN, or FC-84EN Driver: .3.
Mid to large -sized Heterogeneous StorNext configuration MetaData Ethernet Network Apple OSX XSAN Client Linux StorNext Client RHEL or SLES Zone 1 Controller A And all host ports LINUX STORNEXT Meta Data Controller RHEL or SLES RDAC HBA Celerity FC-81EN, FC-82EN, or FC-84EN Driver: .3.1b12 HBA HBA Celerity Celerity FC-81EN, FC-81EN, FC-82EN, FC-82EN, or FC-84EN or FC-84EN Driver: .3.1b12 Driver: .3.
Additional Reference Links IBM DS Series Portal: www.ibmdsseries.com ATTO Technology, Inc: www.attotech.com/solutions/ibm Quantum StorNext: www.stornext.com Apple Xsan: http://www.apple.com/xsan/ Notices This information was developed for products and services offered in the U.S.A. IBM may not offer the products, services, or features discussed in this document in other countries.
Trademarks IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. These and other IBM trademarked terms are marked on their first occurrence in this information with the appropriate symbol (® or ™), indicating US registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries.