IBM System Storage™ Digital Media Storage Solution Installation Guide Selling and Deploying DS3000/DS4000/DS5000 in Mac, Linux, Windows Client, and StorNext Environments Con Rice Modular Storage Product Specialist LSI Corporation 12007 Sunrise Valley Drive, Suite 325 Reston, VA20191 Cell: 703-867-0012 Tel: 703-262-5418 e-mail:con.rice@lsi.
Contents INTRODUCTION ....................................................................................................................... 4 Mac, Windows and Linux Client Connectivity......................................................................... 5 StorNext File Sharing Environments ...................................................................................... 5 CURRENT SOLUTIONS ...........................................................................................................
StorNext Controlled SAN File System .............................................................................. 20 Cooperation Effort Between Apple and Quantum ............................................................. 20 Closing a Case ................................................................................................................. 20 MIGRATING FROM XSAN MDC TO STORNEXT MDC ...................................................... 21 ATTO Technology Inc. .................................
INTRODUCTION This paper outlines support of Windows Client (XP, Vista, and Windows 7), Linux (RHEL and SUSE) and Mac (OS X 10.5 – 10.6.x) with IBM DS3000, DS4000, and DS5000 Storage Servers. It also discusses support in StorNext environments. The solutions discussed arose because of customer demand seen in the media and entertainment industry and within the oil and gas industry.
Mac, Windows and Linux Client Connectivity In recent years, the workflow requirements of the video professional is driving the need for more sophisticated, high-end configurations, which require multiple users to share access to large amounts of data while maintaining the high-throughput performance required for the rich media and content applications they serve.
There are three components to the basic StorNext solution: Clients, Meta Data Controllers (MDCs), and the storage. There are also ancillary components such as the SAN, the TCP/IP network, and optional archive storage such as tape libraries or second tier disks. However, for selling and support purposes the components are software, support, and implementations services.
Windows Servers Linux Servers • FC-81EN, Single Port ATTO (future support), see current compatibility matrix for alternative solutions In mixed MacOS and/or In mixed, environments (those Windows Client (XP, Vista, that include MacOS or Windows Windows 7) environments: : ATTO MultiPath Director ATTO Celerity • FC-84EN, Quad Port In homogenous Linux • FC-82EN, Dual Port environments: RDAC or MPP as • FC-81EN, Single Port appropriate for the particular Linux implemented In homogenous Linux environments, any c
Note: A customer seeking connection that has already deployed Apple Xsan MDC will need to transition to a Quantum StorNext MDC running either on Linux or Windows Server. However the Apple Xsan clients can remain.
• Must use supported ATTO HBA and MultiPath Director driver purchased from ATTO or ATTO Resellers Linux StorNext Clients and MDCs • • • • • Must buy Quantum StorNext software Must buy StorNext Installation services from Quantum Must buy StorNext Gold or Silver support contract from Quantum If the environment includes MacOS and/or Winows Clients (XP, Vista, or Windows 7) Must use supported ATTO HBA and MultiPath Director driver purchased from ATTO or ATTO Resellers If the environment is homogenous Linux,
DS5100, DS5300 • • FC, iSCSI connectivity (480) SSD, FC, SED, SATA d i DS5020 • • FC, iSCSI connectivity (112) FC SED (DS5020 only) SATA drives DS3500 • FC, SAS, iSCSI connectivity DS3200, DS3300, DS3400 • • FC, SAS, iSCSI connectivity (48) SAS SATA drives DS5020 DS5100 base performance DS5300 DS3400 DS3500 DS3500 Turbo Burst I/O rate cache reads (IOPS) 110,000 140,000 174,000 200,000 650,000 700,000 Sustained I/O rate disk reads 21,000 30,000 35,000 50,000 76,000 170,000 Sustain
Sustained throughput disk read (MB/s) 925 2,000 4,000 1,600 1,600 6,400 Sustained throughput disk write (MB/s) 720 1,100 2,400 1,400 1,300 5,300 4 8 8 4 8 16 Host ports Digital Media Storage Solution Installation Guide © Copyright 2010, IBM Corporation. All rights reserved.
Solutions Apple Hardware Connect Only Apple Servers and/or clients with no shared filed access Apple Homogenous Shared File Apple Xsan Clients with Linux MDC (Meta Data Controller) Windows Client Multiple Apple Host Server or Client connected to DS3000/DS4000/DS5000 Storage • Apple Leopard and Snow Leopard • Using ATTO HBAs and ATTO MP Director • Without StorNext or Xsan support • This is basic host connectivity support.
Hardware Connect Only Windows clients with no shared filed access Linux Homogenous Linux StorNext Clients with Linux MDC Heterogeneous Apple Xsan Clients, Linux StorNext Clients, Windows Clients and Linux MDC • • • Windows XP, Vista, Windows 7 • Using ATTO HBAs and ATTO MP Director Without StorNext or Xsan support This is basic host connectivity support.
Client, or mixed: Supported ATTO HBAs Linux SLES 10.2 x64 Linux RHEL 5.
Windows 2008 R2 x86, x64 Supported ATTO HBAs(future) Windows Windows 7 x86 Windows Vista x86 Windows XP x86 Supported ATTO HBAs Supported ATTO HBAs Supported ATTO HBAs As appropriate above Mixed MPIO/DSM, ATTO) ATTO ATTO ATTO As appropriate above SOLUTION RESTRICTIONS AND RECOMMENDATIONS There are several important aspects to the configuring of the SAN that must be understood. The first is that the SAN design is architected to avoid logical drive failover in the storage subsystem.
Storage Controller A Controller B Up to 8 Up to 8 All ports see all MDC and client ports All ports see all MDC and client ports RECOMMENDED RAID CONFIGURATIONS RAID RAID Array Segment Disk type level size size 1 or 10 As required 256 FC or SAS recommended Journal 1 or 10 As required 256 FC or SAS recommended Meta Data • Journal and Meta Data may reside in separate LUNS carved from the same RAID Array if required in small implementations.
SOLUTION INSTALLATION 1. Use a meshed fabric with each HBA zoned to see both controllers but controllers unable to see each other. 2. Use RDAC or MPIO failover drivers as appropriate for your operating systems (ATTO for Apple and/or Windows XP, Vista, or Windows 7). Do not use the StorNext failover driver 3. For Installations that include Apple (MacOS) or Windows (XP, Vista, Windows 7) Clients a. Set host type MacOS b. This will : 1. Set TPGS On 2. Set AVT Off c.
9. For clients, limit the number of defined paths to four. This gives you the redundancy you need while minimizing boot time. During boot, StorNext tries EVERY defined path. Digital Media Storage Solution Installation Guide © Copyright 2010, IBM Corporation. All rights reserved.
10. RAID 1 or 10 for Journal and Meta Data a. Multiple RAID 1 Groups would be preferable to a similarly size RAID 10 b. Placing Meta Data and Journal on a storage system separate from the data is preferable. 11. It is desirable to separate Meta data and Journal LUNS from the Data LUNS. a. In small installations, Meta data, Journal and Data can be different LUNS on the same RAID group b. However, it is best to separate Meta data and Journal into their own RAID 1 RAID group. c.
QUANTUM / APPLE JOINT PRODUCT SUPPORT PROGRAM Quantum / Apple Joint Product Support Program Overview Quantum and Apple have agreed to a cooperative support relationship for Quantum’s StorNext and Apple’s Xsan products. This means joint customers are assured that both companies will work together to resolve any technical issues with our respective products. Xsan Controlled SAN File System In the case of the joint customer having an Xsan controlled SAN file System, (i.e.
MIGRATING FROM XSAN MDC TO STORNEXT MDC Q. Are there new features in Xsan 2.2 that make it harder to swap out XServe MDCs and replace them with StorNext Linux MDCs? A: “NamedStreams” is the Apple Xsan feature that causes some problems with StorNext. If you don’t turn it on, you’re fine. By default, “NamedStreams” is turned on. NamedStreams will make things like the basic StorNext command line copy command, cvcp, not work. Before Xsan 2.2, you could have it copy the “.
ATTO Technology Inc. ATTO Technology, Inc. Value Proposition ATTO Technology is a leader in storage and connectivity solutions. In business since 1988, ATTO has maintained a consistent strategy of technical innovation by continually creating new and exciting Host Bus Adapter (HBA) products that are on the leading edge of the storage market.
ATTO Celerity 8Gb Fibre Channel HBAs Product Features Fibre Channel Ports Maximum Data Rate Maximum Transfer Rate (Full Duplex) Maximum Transfer Rate (Half Duplex) Bus Type Bus Characteristics Optical Interface Maximum Cable Length Low Profile Form Factor Advanced Data Streaming (ADS) Software RAID Support Developers Kit (Target Mode and API) Windows (Server) Windows (work station / client) Linux (Red Hat, SUSE) MAC OSX VMWare ESX RoHS Compliant FC84EN 4 8Gb 6.4 GB/s 3.2 GB/s PCIe 2.
APPENDIX A: EXAMPLE CONFIGURATIONS Large Heterogeneous StorNext configuration Example 1.Drawing depicts large and expandable SAN with heterogeneous client connectivity. Multiple DS5300 connected to meshed SAN fabric with a minimum of two Fibre Channel switches. For DS5100/DS5300 configurations, a minimum of two switches is recommended. Drawing shows multiple DS5300 for Data storage and a separate DS5020 for Meta Data. Digital Media Storage Solution Installation Guide © Copyright 2010, IBM Corporation.
Detailed explanation of example 1. Example Large StorNext configuration showing DS5300’s with Fibre Channel and/or SATA disk for Data and a separate DS5020 for Meta Data and Journal. These examples are representative only and should not be seen as restrictive. The idea is to use our knowledge of these products to craft solutions with the proper performance and resiliency characteristics to meet customer needs and budget concerns.
Mid to large -sized “MAC Homogenous”StorNext configuration Example 2. In this example diagram Linux MDC Servers are shown, but only MAC Xsan Clients are shown. DS5300 connected to meshed SAN fabric with a minimum of two Fibre Channel switches. For DS5100/DS5300 configurations, a minimum of two switches is recommended. Drawing shows minimal SAN to DS5300 connections to simplify the drawing. However, up to 16 connections is supported.
Mid-sized “MAC Homogenous”StorNext configuration Example 4. In this example diagram Linux MDC Servers are shown, but only MAC Xsan Clients are shown. DS5020 connected to meshed SAN fabric with a single Fibre Channel switch. For DS5020 configurations, Multiple Fibre Channel switches are not required, but they are recommended. Drawing shows minimal SAN to DS5020 connections to simplify the drawing. However, up to 8 connections are supported.
Small “MAC Homogenous”StorNext configuration Example 5. In this example diagram Linux MDC Servers are shown, but only MAC Xsan Clients are shown. DS3400 connected to meshed SAN fabric with a single Fibre Channel switch. For DS3400 configurations, Multiple Fibre Channel switches are not required, but they are recommended. Drawing shows minimal SAN to DS3400 connections to simplify the drawing. However, up to 4 connections are supported.
Mid to large -sized Heterogeneous StorNext configuration Example 6. Drawing depicts mid to large size and expandable SAN with heterogeneous client connectivity. DS5300 connected to meshed SAN fabric with a minimum of two Fibre Channel switches. For DS5100/DS5300 configurations, a minimum of two switches is recommended. Drawing shows minimal SAN to DS5300 connections to simplify the drawing. However, up to 16 connections is supported.
APPENDIX B: ATTO HBA AND MULTIPATH DIRECTOR INSTALLATION AND TROUBLESHOOTING MANUAL • Please refer to ATTO Celerity MultiPath Director Manual for installation and troubleshooting. o http://www.attotech.com/software/files/manuals/Manual_Celerity_MultiPathDirector.pdf Digital Media Storage Solution Installation Guide © Copyright 2010, IBM Corporation. All rights reserved.
Additional Reference Links • • • • IBM DS Series Portal: www.ibmdsseries.com ATTO Technology, Inc: www.attotech.com/solutions/ibm Quantum StorNext: www.stornext.com Apple Xsan: http://www.apple.com/Xsan/ Notices This information was developed for products and services offered in the U.S.A. IBM may not offer the products, services, or features discussed in this document in other countries.
Trademarks IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. These and other IBM trademarked terms aremarked on their first occurrence in this information with the appropriate symbol (® or ™), indicating USregistered or common law trademarks owned by IBM at the time this information was published. Suchtrademarks may also be registered or common law trademarks in other countries.