book.
book.book Page 2 Monday, October 17, 2011 3:42 PM Notes, Cautions, and Warnings NOTE: A NOTE indicates important information that helps you make better use of your computer. CAUTION: A CAUTION indicates potential damage to hardware or loss of data if instructions are not followed. WARNING: A WARNING indicates a potential for property damage, personal injury, or death. ____________________ Information in this publication is subject to change without notice. © 2010–2011 Dell Inc. All rights reserved.
book.book Page 3 Monday, October 17, 2011 3:42 PM Contents 1 Introduction . 2 DX Object Storage Platform Overview . . . . . . . . . . . . . . . . . . . . . . . . Network Topologies . . . . 9 . . . . . . . . . . . . . . . . . . . 9 . . . . . . . . . . . . 10 . . . . . . . . . . . . . 14 Local Cluster Configuration. Subcluster Configuration . Remote Cluster Configuration . . . . . . . . . . . DX Cluster File Server Configuration . Application Access to DX Object Storage Platform . . . . . .
book.book Page 4 Monday, October 17, 2011 3:42 PM Using the Dell DX Content Router Rules Configurator . . . . . . . . . . . . . . . . . Troubleshooting the Dell DX Content Router Rules Configurator (CRRC) . . . . . . . . . 25 . . . . . . . . . 26 . . . . . . . . . . 26 . . . . . . . . . . . . . . . 26 Adding Additional DX Storage Nodes . Installing the System in a Rack . Cabling the Appliance Turning On the DX Storage Node . . . . . . . . . . 26 . . . . . . . . . . 27 . . . . . . . . . . .
book.book Page 5 Monday, October 17, 2011 3:42 PM 5 Disaster Recovery . . . . . . . . . . . . . . . . . . 37 Recovery Solution Map . . . . . . . . . . . . . . . . . 37 . . . . . . . . . . . . . 39 . . . . . . . . . . . . . . . . . 39 . . . . . . . . . . . . . . . . . . 39 Recovering From Disk Failures Single Disk Failure Two Disk Failure . . . . . . . . 39 . . . . . . . . . . . 40 . . . . . . . . . . . .
book.book Page 6 Monday, October 17, 2011 3:42 PM 6 Configuring the DX Cluster Services Node Software . . . . . . . . . . . . . . . . . . . . . . 48 Restoring the Cluster Configurations . . . . . . . . . . 48 Bringing Up the DX Storage Cluster . . . . . . . . . . . 48 Additional References . . . . . . . . . . . . . . Software Documents . . . . . . . . . . . . . . . . . . . 49 Hardware Documents . . . . . . . . . . . . . . . . . . 51 Systems Management Documents . 6 Contents 49 . . . .
book.book Page 7 Monday, October 17, 2011 3:42 PM 1 Introduction The Dell DX Object Storage Platform provides a simple and cost effective pool of storage for less active or fixed content. The object storage platform allows you to: • Expand the capacity to meet rapidly changing needs without disrupting services. • Set policies for file retention and replication. • Distribute information to multiple geographic locations. • Integrate through an HTTP based interface.
book.book Page 8 Monday, October 17, 2011 3:42 PM Table 1-1 lists the terms used in this document to refer to various components of the DX Object Storage Platform. Table 1-1.
book.book Page 9 Monday, October 17, 2011 3:42 PM DX Object Storage Platform Overview 2 Network Topologies The Dell DX Object Storage Platform network consists of one or more DX Storage Clusters connected by DX Content Router services. There are many possible network topologies depending on the storage network goals. All networks share the following features: • One or two DX Cluster Services Nodes that provide services to the storage cluster.
book.book Page 10 Monday, October 17, 2011 3:42 PM Network switch configuration depends on both the network topology and the customer environment. To ensure proper functioning with default network parameters and to maximize cluster performance, it is recommended that you follow the best practices listed below, while configuring both the private and public networks switches. • Disable link aggregation configuration as the DX Object Storage Nodes bond the system NIC ports in balanced-alb modes.
book.book Page 11 Monday, October 17, 2011 3:42 PM It is recommended that you configure the network topology to enable applications to communicate with the DX Storage Nodes on private and secure networks. This is the primary method to store and retrieve data from a local DX Storage Cluster. NOTE: If applications write to a cluster through an unsecure network, then to prevent malicious activity, it is recommended that you allow the application to encrypt the data before writing the data to the cluster.
book.book Page 12 Monday, October 17, 2011 3:42 PM Redundant DX Cluster Services Nodes The Dell DX Storage Cluster supports redundant DX Cluster Services Nodes. In a redundant model, the active DX Cluster Services Node is configured as the primary node and the redundant node is configured as the secondary node. See Figure 2-2. The primary Cluster Services Node contains the cluster configuration files, active networking utilities, and active content router services.
book.book Page 13 Monday, October 17, 2011 3:42 PM Figure 2-2.
book.book Page 14 Monday, October 17, 2011 3:42 PM Subcluster Configuration A Dell DX Storage Cluster can be split into two or more subclusters. The subclusters are physically part of the same cluster but are recognized as logically separate entities by the DX Object Storage software that provides local area replication.
book.book Page 15 Monday, October 17, 2011 3:42 PM Figure 2-3.
book.book Page 16 Monday, October 17, 2011 3:42 PM Remote Cluster Configuration When you deploy multiple DX Storage Clusters (for example multiple sites, offsite backup, and so on), the DX Cluster Services Node provides the ability to replicate data between DX Storage Clusters using the DX Content Router software. The DX Content Router provides two services: • Publisher service • Replicator service Clusters are connected by one cluster's replicator service to another cluster's publisher service.
book.book Page 17 Monday, October 17, 2011 3:42 PM Figure 2-4.
book.book Page 18 Monday, October 17, 2011 3:42 PM DX Cluster File Server Configuration When you deploy a DX Cluster File Server (CFS), the CFS must have direct access to the DX Storage Cluster on the private network and the public network. Gigabit Ethernet or higher is the recommended connection speed between the CFS server and the DX Storage Cluster Nodes. The CFS contains six Ethernet ports.
book.book Page 19 Monday, October 17, 2011 3:42 PM Communicating Directly With a Remote Cluster Applications may communicate with a remote DX Storage Cluster during local-cluster disaster recovery. For an application to communicate to a remote DX Storage Cluster, the DX Cluster Services Node on the remote public network must be addressed.
book.
book.book Page 21 Monday, October 17, 2011 3:42 PM 3 Setting Up the DX Object Storage Platform Installing the Initial Cluster or Redundant Cluster Services Node The Dell DX Object Storage Platform consists of at least one DX Cluster Services Node and two DX Storage Nodes. Installation of the initial cluster or additional Cluster Services Nodes require deployment services from Dell. For information about setting up the hardware, see: • the Getting Started Guide for your Dell DX6a00 system at support.
book.book Page 22 Monday, October 17, 2011 3:42 PM • Simple Network Management Protocol (SNMP) options • Setting persistent cluster settings • Storing configuration files For more information about these options, see the Cluster Services Node Installation and Configuration Guide at support.dell.com/manuals. NOTE: Use the Cluster Services Console for normal management and configuration.
book.book Page 23 Monday, October 17, 2011 3:42 PM Using the Dell DX Content Router Rules Configurator The CRRC runs on a DX Cluster Services Node (CSN) in a DX Storage cluster. It configures the rules.xml file located at /etc/caringo/contentrouter/rules.xml. For more information on the rule sets, see the Content Router Setup and Configuration Guide at support.dell.com.
book.book Page 24 Monday, October 17, 2011 3:42 PM 5 In Filter a stream by header or lifepoint?, select header to filter the stream by its header, or select lifepoint to filter the stream by its lifepoint.
book.book Page 25 Monday, October 17, 2011 3:42 PM NOTE: When you save the selected rule set, CRRC creates a backup file of the current rules.xml at /etc/caringo/contentrouter/. The backup file is named using a prefix of rules and the current date/time using the format MMddyyyy_HHmmss where dd=day, MM=month, yyyy=year, HH=hour, mm= minute, ss=second (for example, rules_10082011_123356.xml). NOTE: If you select Modify current rule set in the Home screen, the Validate button is displayed.
book.book Page 26 Monday, October 17, 2011 3:42 PM Adding Additional DX Storage Nodes Before setting up the DX Storage Node, locate the Getting Started Guide shipped with your Dell DX6axyS system. Unpack and set up the DX platform hardware. To set up the DX Storage Node hardware: 1 Rack and cable the DX6axyS system. 2 Turn on the DX6axyS system. 3 Enable capacity in the DX Cluster Services console. NOTE: The DX Storage Node is preconfigured to network boot from the DX Cluster Services Node.
book.book Page 27 Monday, October 17, 2011 3:42 PM Enabling Capacity in DX Cluster Services Console The DX Storage Cluster capacity is licensed. To expand the cluster capacity, you must purchase a capacity license. On purchasing a capacity license, you receive a capacity license card that contains an activation code. Enter the activation code in the DX Cluster Services console to enable the additional cluster capacity. NOTE: The capacity is only applicable to the cluster in which it is entered.
book.book Page 28 Monday, October 17, 2011 3:42 PM 3 Connect the Ethernet cable(s) for the external and internal network accordingly. See Figure 3-5. 4 Turn on the DX Cluster Services Node. 5 Change the IP address of the external network interface to a new valid IP address from the Content Services Configuration page of the DX Cluster Services Administration console.
book.book Page 31 Monday, October 17, 2011 3:42 PM Updating the Dell DX Object Storage Platform Software 4 Updates for the Dell DX Object Storage Platform software are periodically made available to correct problems, improve performance, introduce new capabilities, and support additional hardware. It is recommended that you download the updates to ensure that the cluster runs optimally. See the Dell DX Object Storage Platform Interoperability Guide at support.dell.
book.book Page 32 Monday, October 17, 2011 3:42 PM • Operating system • DX Cluster File Server software Checking Software Version Compatibility The versions of the software and hardware components installed in the cluster are checked by the Dell DX Compatibility Manager which is installed on the DX Cluster Services Nodes. The Compatibility Manager collects information about the current BIOS, firmware, drivers, and software versions in your cluster.
book.book Page 33 Monday, October 17, 2011 3:42 PM To verify cluster compatibility: 1 Open the file /opt/dell/dellACM/CMREPORT.TXT on the primary Cluster Services Node. 2 Review the status information for the Cluster Services Node and the individual Storage Nodes. 3 For more detailed component status information, run the following command: #/opt/dell/dellACM/dellacmscr.
book.book Page 34 Monday, October 17, 2011 3:42 PM Updating the DX Cluster Services Node Software Updates for the operating system, BIOS, firmware, device drivers, and the application software are available at support.dell.com/support/downloads. NOTE: Ensure that you provide the Service Tag or system model on the Driver and Downloads page before you search for system software updates.
book.book Page 35 Monday, October 17, 2011 3:42 PM To update the software used in the storage cluster: 1 Install the new rpm using the following command: rpm -ivh [new version] A new DX Storage Node software version is displayed on the Cluster Services Node console after a successful installation of the storage node software on the DX Cluster Services Node. 2 To view the DX Storage Node software version, click Cluster Services Netboot Management.
book.book Page 36 Monday, October 17, 2011 3:42 PM Updating the DX Cluster File Server Software Updates for the system operating system, BIOS, firmware, device drivers, and the application software are available at support.dell.com/downloads. NOTE: Ensure that you provide the Service Tag or system model details on the Driver and Downloads page before you search for system software updates.
book.book Page 37 Monday, October 17, 2011 3:42 PM 5 Disaster Recovery You can recover the Dell DX Cluster Services Node from a number of hardware or software failures. NOTE: Contact Dell support if you need assistance on disaster recovery for the DX Cluster File Server.
book.book Page 38 Monday, October 17, 2011 3:42 PM Table 5-1.
book.book Page 39 Monday, October 17, 2011 3:42 PM Recovering From Disk Failures NOTE: The DX Cluster Services Node system's internal disk storage is preconfigured as RAID 5. Single Disk Failure The CSN is configured as RAID 5 to ensure uninterrupted operation of the system if a single disk fails. If a single disk failure occurs, replace the failed hard drive. For more information, see Hardware Owner's Manual for the affected system at support.dell.com/manuals.
book.book Page 40 Monday, October 17, 2011 3:42 PM You can use the following methods to monitor the health of the disks: • Hard drive LED indicators—Monitors the drive activity and reports failures. For more information, see the system’s Hardware Owner's Manual at support.dell.com/manuals. • Dell OpenManage Server Administrator—Monitors the health of the internal disks. • Dell Management Console—Centrally monitors the status of Dell systems.
book.book Page 41 Monday, October 17, 2011 3:42 PM Recovering the Operating System Use the Unified Server Configurator - LifeCycle Controller Enabled (USCLCE) utility on the system to recover the operating system. For specific instructions, see "Deploying the Operating System using the OS Deployment Wizard" in the Dell Unified Server Configurator - LifeCycle Enabled User Guide at support.dell.com/manuals.
book.book Page 42 Monday, October 17, 2011 3:42 PM 4 In the Allowable Drives field, de-select the sdb volume. 5 Create a 10 GB restore partition of the file system type physical volume (LVM) within the sda and click OK. 6 Select /dev/sdb1 from the Device list and click Edit. 7 Select Format partition as ext3. 8 In the Mount Point field, enter /u01 and click OK. The /u01 mount point occupies the entire space of the sdb. 9 Click Next.
book.book Page 43 Monday, October 17, 2011 3:42 PM 6 Create the /u01 directory in root directory and mount the file system to the /u01 directory. For example, run the following command: mkdir /u01 mount /dev/sdb1 /u01 7 To keep the mount path persistent across reboot, add the mount path to /etc/fstab. For example, run the following command: vi /etc/fstab Table 5-2 lists the options that must be selected to create a mount path. Table 5-2.
book.book Page 44 Monday, October 17, 2011 3:42 PM NOTE: Network switch configuration is outside the scope of the DX Cluster Services Node software. Switches must be properly configured by a system administrator to ensure correct connectivity and bonding mode support. Administrators must not connect the configured internal network ports to the external network.
book.book Page 45 Monday, October 17, 2011 3:42 PM x86_64\ DVD. The white spaces in this file path causes errors during the YUM setup process. If the drive auto mounts, run the following commands: # mkdir /media/dvd # mount --move /media/RHEL_x.x\ x86_64\ DVD /media/dvd If the CDROM does not auto mount, perform the following commands.
book.book Page 46 Monday, October 17, 2011 3:42 PM Installing Dell DX Compatibility Manager The Dell DX Compatibility Manager is available as an rpm package. To install the DX Compatibility Manager: 1 Download the latest version of rpm package from support.dell.com. 2 Copy the rpm package to a directory on your system. 3 Install the rpm package using the following command: # rpm –i .
book.book Page 47 Monday, October 17, 2011 3:42 PM The Server Administrator is designed for system administrators to manage systems locally and remotely on a network. It allows system administrators to focus on managing their entire network by providing comprehensive one-toone systems management. You can install Server Administrator using the Dell Systems Management Tools and Documentation media.
book.book Page 48 Monday, October 17, 2011 3:42 PM 3 Install the DX Cluster Services Node software by running the self-extracting script from inside the bundle directory location where the shell script was unzipped. This initiates installation of the DX Cluster Services Node software and its dependent packages. For more information, see the Cluster Services Node Installation and Configuration Guide at support.dell.com/manuals.
book.book Page 49 Monday, October 17, 2011 3:42 PM 6 Additional References Software Documents Table 6-1. Software Documents Document Description Location DX Storage Compression Node Deployment Guide Covers the steps required to configure a Storage Compression Node. support.dell.com/manuals Dell DX Object Storage Platform User's Guide Provides an overview of the support.dell.com/manuals DX Object Storage Platform and steps to upgrade and recover the platform.
book.book Page 50 Monday, October 17, 2011 3:42 PM Table 6-1. Software Documents (continued) Document Description DX Object Storage Application Guide Guides application support.dell.com/manuals programmers who are developing or customizing client-side programs. Content Router Setup and Configuration Guide Covers the steps required to configure Content Router and the administration actions necessary to monitor and run one or more Content Router nodes.
book.book Page 51 Monday, October 17, 2011 3:42 PM Hardware Documents Table 6-2. Hardware Documents Document Description Location Dell DX6000 Getting Started With Your System Helps you get started with the Dell DX6000 systems. support.dell.com/manuals Dell DX6000 Hardware Owner's Manual Contains information specific to your Dell hardware. support.dell.com/manuals Dell DX6012S Getting Started With Your System Helps you get started with the Dell DX6012S systems. support.dell.
book.book Page 52 Monday, October 17, 2011 3:42 PM Table 6-2. Hardware Documents (continued) Document Description Location Dell DX Support Matrix Compatibility Matrix for the support.dell.com/manuals DX Object Storage Platform. Systems Management Documents Table 6-3. Systems Management Documents Document Description Dell OpenManage Software Installation and Security User's Guide Describes how to install Dell support.dell.com/manuals OpenManage Server Administrator software.
