HP Virtual Connect for c-Class BladeSystem Setup and Installation Guide Abstract This document contains setup, installation, and configuration information for HP Virtual Connect Manager, v3.60 and lower. This document is for the person who installs, administers, and troubleshoots servers and storage systems. HP assumes you are qualified in the servicing of computer equipment and trained in recognizing hazards in products with hazardous energy levels.
© Copyright 2010, 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein. Microsoft® and Windows® are U.S.
Contents Documentation resources ............................................................................................................... 6 Virtual Connect documentation ...................................................................................................................... 6 Planning the installation ................................................................................................................. 7 Virtual Connect overview ..............................................
Logging on to the HP Virtual Connect Manager GUI ...................................................................................... 53 About HP Virtual Connect Manager ............................................................................................................. 54 Reset Virtual Connect Manager ................................................................................................................... 54 Recovering remote enclosures .................................................
Declaration of conformity for products marked with the FCC logo, United States only...................................... 120 Modifications ........................................................................................................................................... 120 Cables .................................................................................................................................................... 120 Canadian notice (Avis Canadien) ....................................
Documentation resources Virtual Connect documentation The following Virtual Connect documentation is available on the Installing tab of the HP BladeSystem Technical Resources website (http://www.hp.com/go/bladesystem/documentation): • HP Virtual Connect for c-Class BladeSystem User Guide This guide provides details for the Virtual Connect GUI, including descriptions of screen contents and steps to set up domains, profiles, networks, and storage.
Planning the installation Virtual Connect overview HP Virtual Connect is a set of interconnect modules and embedded software for HP BladeSystem c-Class enclosures that simplifies the setup and administration of server connections.
Enclosure for a total of 8 servers (or up to 16 servers if the double-dense option is enabled). For more information on the double-dense option, see "Double-dense server bay option" in the user guide.
• Be sure that the firmware revisions on all VC modules in the domain are at the same revision level. The active VCM does not allow incompatible modules to be managed as part of the same VC domain. For more information, see "Firmware requirements (on page 13)." • Be sure that OA, iLO, server blade system ROM, Ethernet option ROM, and FC option ROM firmware are up-to-date. For more information, see "Firmware requirements (on page 13).
Hardware setup overview The following steps provide an overview of setting up the interconnect modules: 1. Install and set up the enclosure. See the appropriate HP BladeSystem enclosure quick install instructions on the Installing tab of the HP BladeSystem Technical Resources website (http://www.hp.com/go/bladesystem/documentation). 2. Install the interconnect modules ("Installation" on page 13). Plan your installation carefully.
IMPORTANT: For proper management of enclosure devices there must be an Ethernet connection from the Onboard Administrator module to the external management network. For information on Onboard Administrator module cabling, see the HP BladeSystem Onboard Administrator User Guide. Default module configuration When VC modules are inserted into an enclosure that is not yet part of a Virtual Connect domain, the modules are configured to provide basic connectivity.
5. If you created associated networks using the network setup wizard, all networks are assigned to the Default network access group. You must be sure that all networks are in the proper network access group before running the server profile setup wizard. For more information about editing network access groups, see "Edit Network Access Group screen" in the user guide. 6. Run the server profile setup wizard ("HP Virtual Connect Manager Server Profile Setup Wizard" on page 84). a.
Installation Firmware requirements IMPORTANT: The active VCM does not allow incompatible modules to be managed as part of the Virtual Connect domain. IMPORTANT: For optimal operation of HP Virtual Connect, use the recommended firmware versions.
• For each Ethernet mezzanine port you want to manage with VCM, install a VC-Enet or HP VC FlexFabric 10Gb/24-port Module in the interconnect bay connected to that port. For more information, see the appropriate HP BladeSystem enclosure setup and installation guide. • For Ethernet connections, Virtual Connect can be configured to assign or migrate MAC addresses for device bay ports connected to VC-Enet or FlexFabric modules.
VC firmware version Enclosure FlexFabric Support Ethernet support FC support 1.20 c3000 — Up to 4 modules Up to 2 modules 1 2.10 c7000 — 2.10 c3000 — Up to 16 Up to 16 Up to 4 modules modules Up to 4 modules Up to 2 modules 1 3.00 c7000 — 3.00 c3000 — 3.10 c7000 — 3.10 c3000 — Up to 16 Up to 16 Up to 4 modules modules Up to 4 modules Up to 2 modules 1 3.15/3.17 c7000 3.15/3.
[Bay 1] VC Ethernet [Bay 2] VC Ethernet [Bay 3] Other/empty [Bay 4] Other/empty [Bay 5] VC Ethernet [Bay 6] VC Ethernet [Bay 7] Other/empty [Bay 8] Other/empty [Bay 1] VC Ethernet [Bay 2] VC Ethernet [Bay 3] VC Ethernet [Bay 4] VC Ethernet [Bay 5] VC Ethernet [Bay 6] VC Ethernet [Bay 7] Other/empty [Bay 8] Other/empty [Bay 1] VC Ethernet [Bay 2] Empty [Bay 3] VC-FC [Bay 4] Empty [Bay 5] Other/empty [Bay 6] Other/empty [Bay 7] Other/empty [Bay 8] Other/empty [B
[Bay 7] Other/empty [Bay 8] Other/empty [Bay 1] VC Ethernet [Bay 2] VC Ethernet [Bay 3] VC Ethernet [Bay 4] VC Ethernet [Bay 5] VC Ethernet [Bay 6] VC Ethernet [Bay 7] VC Ethernet [Bay 8] VC Ethernet HP BladeSystem c3000 Enclosure supported configurations The following tables show several typical, supported configurations for an HP BladeSystem c3000 Enclosure. In the following tables, "Other" indicates any c-Class interconnect module including a VC, Pass-Thru, or switch.
Modules or HP 1/10 Gb-F Ethernet Modules if HP VC Flex-10 and FlexFabric modules are present in the same enclosure. However, homogeneous 1/10 Gb module multi-enclosure configurations are acceptable. • To set up and configure VCM, an odd-numbered interconnect bay must be populated with a VC-Enet module or FlexFabric module. The lowest odd-numbered interconnect bay populated with a VC-Enet module or FlexFabric module becomes the primary VC module.
Odd numbered bay Horizontally adjacent bay Good configuration? Notes 1/10Gb-F Enet 1/10Gb Enet Yes — 1/10Gb Enet 4Gb FC No Do not mix Ethernet and FC modules in horizontally adjacent bays. 4Gb FC 4Gb FC Yes Bays 3 and 4 of adjacent enclosures must also contain FC modules. 4Gb FC 4Gb FC with enhanced NPIV Yes You can mix HP 4Gb VC-FC modules and HP Virtual Connect 4Gb FC modules (with enhanced NPIV) in horizontally adjacent bays.
HP Virtual Connect FlexFabric 10Gb/24-port Module guidelines The following guidelines apply to the installation or replacement of HP Virtual Connect FlexFabric 10Gb/24-port Modules: • For full storage network compatibility, each server blade attached to the HP VC FlexFabric 10Gb/24-port Module must have either an embedded or mezzanine-based FlexFabric converged network adapter.
the servers continue to have network and storage access. Both the Primary and Standby modules in the base enclosure must be recovered to regain management access to the VC domain. Virtual Connect and EBIPA Enclosure Bay IP Addressing is used to specify IP addresses for the interconnect modules, which are then provided to the modules by the Onboard Administrator.
Single enclosure stacking diagram Modules (top to bottom) HP Virtual Connect FlexFabric 10Gb/24-port Modules HP Virtual Connect Flex-10 10Gb Ethernet Modules Stacking four modules • • • • HP Virtual Connect FlexFabric 10Gb/24-port Modules HP Virtual Connect FlexFabric 10Gb/24-port Modules HP Virtual Connect FlexFabric 10Gb/24-port Modules HP Virtual Connect Flex-10 10Gb Ethernet Modules Stacking six modules • • • HP Virtual Connect FlexFabric 10Gb/24-port Modules HP Virtual Connect FlexFabric 1
Single enclosure stacking diagram Modules (top to bottom) • • • • • • HP Virtual Connect FlexFabric 10Gb/24-port Modules HP Virtual Connect FlexFabric 10Gb/24-port Modules HP Virtual Connect Flex-10 10Gb Ethernet Modules HP Virtual Connect FlexFabric 10Gb/24-port Modules HP Virtual Connect Flex-10 10Gb Ethernet Modules HP 1/10Gb-F VC-Enet Modules* Stacking eight modules • • • • • • • • HP Virtual Connect FlexFabric 10Gb/24-port Modules HP Virtual Connect FlexFabric 10Gb/24-port Modules HP Vir
Single enclosure stacking diagram Modules (top to bottom) Ethernet Modules *HP 1/10Gb VC-Enet Modules and HP 1/10 Gb-F Ethernet Modules are not supported as primary and backup modules in multi-enclosure configurations.
• It monitors and intercepts common loop detection frames used in other switches. In network environments where the upstream switches send loop detection frames, the VC Enet modules must ensure that any downlink loops do not cause these frames to be sent back to the uplink ports.
imported into the domain before importing additional (remote) enclosures. If a failure occurs, the standby module in the primary enclosure takes over. The VC manager in the primary enclosure accesses all remote modules and OAs over the management network. The OAs for each enclosure to be managed as part of a VC domain must be on the same management subnet along with all of the VC-Enet, FlexFabric, and VC-FC modules that are in each enclosure.
IMPORTANT: In a single enclosure domain, HP recommends that you do not manage the VC domain from HP 1/10 Gb VC-Enet Modules or HP 1/10 Gb-F Ethernet Modules if FlexFabric modules exist in the same enclosure. In a multi-enclosure domain, you cannot manage the VC domain from HP 1/10 Gb VC-Enet Modules or HP 1/10 Gb-F Ethernet Modules if HP VC Flex-10 and FlexFabric modules are present in the same enclosure. However, homogeneous 1/10 Gb module multi-enclosure configurations are acceptable.
For example, in a multi-enclosure domain with a total of four enclosures, if bays 3 and 4 of the Primary Enclosure contain VC-FC modules, then bays 3 and 4 of Remote Enclosures 1, 2, and 3 must also contain VC-FC modules. If bays 1 and 2 of the Primary Enclosure contain FlexFabric modules, then bays 1 and 2 of Remote Enclosures 1, 2, and 3 must also contain FlexFabric modules. The following illustration shows a valid VC-FC and FlexFabric bay configuration.
The following illustration shows an invalid VC-FC and FlexFabric bay configuration. For VC-FC bay compatibility, Bay 4 in Remote Enclosure 1 is empty, and Bay 3 of Remote Enclosure 2 has an Ethernet module present. For FlexFabric bay compatibility, Bay 2 in Remote Enclosure 1 is empty, and Bay 1 of Remote Enclosure 2 has an Ethernet module present.
You can also directly associate the uplinks from two enclosures from different domains so that servers in the two domains attached to the networks configured for those uplinks can communicate with one another. This configuration establishes a private communication path between the two enclosures. However, the communication path is public for all of those servers and applications associated with it. Traffic would not flow from an upstream switch over that direct connection.
2. Prepare the VC-Enet module for installation (HP VC Flex-10 10Gb Ethernet Module shown). 3. Install the module into the interconnect bay (HP VC Flex-10 10Gb Ethernet Module shown). Push the module in slowly and smoothly until it is firmly seated. 4. If the Virtual Connect configuration includes three or more VC-Enet modules, install stacking links (typically 10GBASE-CX4 cables) between the modules. For more information, see "Connecting Virtual Connect Ethernet Module uplinks (on page 39)." 5.
IMPORTANT: For proper thermal operation, always install SFP dust covers in SFP ports without SFP transceivers installed. 6. Remove the perforated portion of the Default Network Setting label that extends beyond the faceplate of the primary module, or record the information contained on the label. The Default Network Settings label contains the DNS name, user name, and password of the primary interconnect module. This information is required for access to VCM. 7. Power on and configure the enclosure.
c-Class BladeSystem User Guide on the Installing tab of the HP BladeSystem Technical Resources website (http://www.hp.com/go/bladesystem/documentation). Installing the HP Virtual Connect FlexFabric Module The HP Virtual Connect FlexFabric 10/24-port Module can be used in an HP BladeSystem c7000 Enclosure. To install the component: 1. Remove the interconnect blank. NOTE: HP Virtual Connect works optimally in enclosures configured with HP Virtual Connect interconnect modules only. 2.
3. Install the FlexFabric module into the interconnect bay. 4. If the enclosure configuration includes more than one VC module, connect any necessary stacking cables between the modules. The FlexFabric module supports stacking links for Ethernet traffic only. For more information, see the HP Virtual Connect for c-Class BladeSystem User Guide on the Installing tab of the HP BladeSystem Technical Resources website (http://www.hp.com/go/bladesystem/documentation). 5.
12. Before accessing VCM, verify that the HP BladeSystem Onboard Administrator firmware is at the recommended firmware version. For specific instructions, see the HP website (http://www.hp.com/go/bladesystemupdates). IMPORTANT: For proper Virtual Connect operation, always assign an IP address to each server blade iLO and interconnect module. 13. Verify that each server blade iLO and interconnect module has been assigned an IP address by reviewing the bay summary screens in the Onboard Administrator.
2. Prepare the VC-FC module for installation (HP Virtual Connect 4Gb Fibre Channel Module shown). 3. Install the VC-FC module into the interconnect bay (HP Virtual Connect 4Gb Fibre Channel Module shown). Push the module in slowly and smoothly until it is firmly seated. 4. Connect the data center SAN switch ports to the VC-FC module 1/2/4 Gb SFP ports. IMPORTANT: For proper thermal operation, always install SFP dust covers in SFP ports without SFP transceivers installed.
6. Configure the VC-FC module: o If VC-Enet modules are installed in the same enclosure, use VCM to administer VC-FC modules. o If VC-Enet modules are not installed in the same enclosure, the VC-FC module operates in the default configuration only. Installing SFP/SFP+/XFP transceivers WARNING: To avoid serious injury, never look directly into an open transceiver port.
Removing SFP/SFP+/XFP transceivers WARNING: To avoid serious injury, never look directly into an open transceiver port. CAUTION: Disconnect all cables before removing or installing an SFP/SFP+/XFP transceiver, because of the potential damage to the cables, the cable connector, or the optical interfaces in the transceiver. Removing and installing a transceiver can shorten the useful life. Do not remove and insert transceivers more often than is necessary. 1. Disconnect all cables. 2. Open the latch. 3.
Connecting Virtual Connect Ethernet module uplinks Each interconnect module has several numbered Ethernet connectors. All of these connectors can be used to connect to data center switches (uplink ports), or they can be used to stack Virtual Connect modules as part of a single Virtual Connect domain (stacking ports). See "Recommended stacking connections (on page 21)." Networks must be defined within VCM so that specific named networks can be associated with specific external data center connections.
In this case, the Ethernet packets are passed unchanged between the server blades and the external networks. Any VLAN tags added by the server or external switch are ignored and pass through the VC-Enet modules. The previous figure also shows a local connection between Server Blade 2 and Server Blade 16, which might be used in a cluster or as a network heartbeat.
To make VCM aware of individual network connections, see "Define Ethernet Network screen" in the user guide. Mapping multiple networks to a single port in a shared uplink set The network administrator can choose to reduce the number of cables between the Virtual Connect enclosure and the data center switches by mapping multiple networks to a single, shared uplink port. In this case, a network is not just mapped to an uplink port, but to a VLAN on that port.
Network Shared uplink set and VLAN Production_Network Shared_Uplink_Set_A:VLAN_15 Dev_Network Shared_Uplink_Set_A:VLAN_21 Backup_Network Shared_Uplink_Set_A:VLAN_32 iSCSI_Storage_Network Shared_Uplink_Set_A:VLAN_76 In this example, all of the defined networks share a single active uplink port (such as Enclosure1:Bay1:PortX2) using VLAN tagging, while the second link in the shared uplink set is available for failover. The shared uplink set can also be constructed from multiple 1-Gb external ports.
On switches running CatOS, you can only change channel mode per module. In the following example, change the channel mode for slots 1 and 2 by using the following command: set channelprotocol lacp module_number Verify the changes by using the following command: show channelprotocol. CatOSSwitch (enable) Mod 1 is set to LACP CatOSSwitch (enable) Mod 2 is set to LACP CatOSSwitch (enable) Channel Module Protocol ------- -------1 LACP 2 LACP 3 PAGP 5 PAGP set channelprotocol lacp 1 protocol.
switchport switchport trunk encapsulation dot1q switchport trunk allowed vlan 10,20,30,40 switchport mode trunk no ip address speed 1000 channel-protocol lacp channel-group 10 mode active Failover and check-pointing VCM runs as a high-availability pair when VC-Enet modules are installed in horizontally adjacent interconnect bays. The active VCM is usually on the lowest odd numbered bay when the enclosure is powered up.
Interconnect module removal and replacement Virtual Connect modules In VC releases prior to 3.00, when a module was removed from an enclosure and was no longer in use by the domain, it had to be removed from the domain using the "Remove from Domain" feature available in the GUI and VCM CLI. Starting with VCM firmware version 3.00, it is no longer necessary to remove the module from the domain if the module is not in use.
Upgrading to an HP Virtual Connect 8Gb 24-Port FC Module Upgrading to an HP VC 8Gb 24-Port FC Module requires several important steps, depending on the starting configuration. Replacing an HP 4Gb VC-FC Module, HP VC 4Gb FC Module, or HP 8Gb 20-Port FC Module with an HP VC 8Gb 24-Port FC Module 1. Upgrade the VC domain firmware to v2.10 or higher. 2. Verify that the replacement will result in a good configuration. See "Multiple enclosure guidelines (on page 20)." 3.
8. Install the HP VC 8Gb 20-port FC Modules. 9. Re-create previously deleted FC SAN fabrics. 10. Re-assign the server profiles, and then add the FC connections to the profiles. Possible errors If the previous steps are not followed exactly, the module might be set to the UNKNOWN or INCOMPATIBLE state depending on how the error state was reached. The module should be physically removed. Then, the correct module type can be inserted.
7. Install the HP Virtual Connect Flex-10 modules or FlexFabric modules. 8. Reassign the server profiles or add the connections to the profiles, depending on what was done in step 3.
Upgrading to an HP Virtual Connect FlexFabric module from a VC-FC module Replacing any VC-FC module with an HP VC FlexFabric module: 1. Upgrade the VC domain firmware to v3.15 or higher. 2. Verify that the replacement will result in a good configuration. See "Multiple enclosure guidelines (on page 20)." 3. Verify that the user has Server privileges. 4. Remove any FC profile connections that are connected to the interconnect bays being upgraded by deleting the connections from the profile. 5.
HP Virtual Connect Manager Configuring browser support Access to the VCM GUI is provided through HTTPS (HTTP exchanged over an SSL-encrypted session) and requires HTTPS (port 443) to be enabled on the management network. For optimal viewing, HP recommends setting the screen resolution to 1280 x 1024. Requirements The VCM web interface requires an XSLT-enabled browser with support for JavaScript 1.3 or the equivalent. The following browsers are supported: • Microsoft Internet Explorer 8.x and 9.
The recommended Adobe Flash Player web browser plug-in can be downloaded and installed from the Adobe website (http://get.adobe.com/flashplayer/), or downloaded as a standalone executable from the Adobe website (http://www.adobe.com/downloads). For the latest Adobe Flash Player Security Bulletin Updates, see the Adobe website (http://www.adobe.com/support/security/index.html#flashplayer). • Pop-up windows Pop-up windows must be enabled for certain features to function correctly.
• Log on to the enclosure Onboard Administrator. From the rack overview screen, select the Virtual Connect Manager link from the left navigation tree. The Onboard Administrator firmware must be version 3.21 or higher. • Log on to the enclosure Onboard Administrator. To display the Interconnect Bays summary screen, select Interconnect Bays in the left navigation tree of the Onboard Administrator user interface. Select the Management URL link for the primary VC-Enet module.
Logging on to the HP Virtual Connect Manager GUI Log on using the user name (Administrator) and password. You can optionally specify the authentication method or VCM role at log on: • To specify the authentication method (local, ldap, radius, tacacs), enter the authentication method followed by a colon before the user name. For example, ldap:user1. • To specify the VCM role (domain, network, server, storage), enter the role followed by a colon before the user name. For example, network:user1.
• The attempted IP sign-in address is not valid for the specified account. • The attempted IP sign-in address is for a VC-Enet module not running the primary VCM. • The browser settings are incorrect. See "Configuring browser support (on page 50)." • You have entered an invalid role or authentication service name. • Authentication service is disabled, is not correctly configured, or is not up in the server.
Plan your interconnect module usage carefully before running the Virtual Connect Domain Setup Wizard. After an interconnect bay is configured for use with a VC module, it remains configured for that module type until the module is removed or the overall VC domain is deleted. Virtual Connect reports failures for any VC module that is removed from the domain. Before getting started, perform the following tasks: • Verify that the HP Onboard Administrator is running the latest firmware (must be v3.
IMPORTANT: An Onboard Administrator user name and password with full administrative privileges for the selected enclosure is required. Enter the user name and password for the enclosure Onboard Administrator. The local enclosure is detected and selected automatically. If an error appears, it indicates that an invalid Onboard Administrator user name and password, or one without sufficient privileges, might have been used. After you import the remote enclosure, the OA IP address must not change.
For more information, see "Using double-dense server blades (on page 59)." Select the appropriate method for creating the Virtual Connect domain. • To create the Virtual Connect domain by importing an enclosure, select the "Create a new Virtual Connect domain by importing this enclosure" radio button, and then click Next. This process can take several minutes as VCM establishes contact with each module in the enclosure and identifies its capabilities.
Enclosure Import After making the selection to create a new Virtual Connect domain by importing the enclosure on the Enclosure Import/Recovery screen, the Import Status screen appears and provides information about whether the import was successful. If the import is not successful, error information is displayed. Importing additional enclosures To import additional enclosures using the Domain Setup Wizard after the initial enclosure has been imported: 1. Select Tools > Domain Setup Wizard. 2.
6. Click Import. Using double-dense server blades Beginning with version 1.31, Virtual Connect Manager supports the use of double density server blades, which means support for up to 32 device bays in a single c7000 enclosure. This support also provides 32 new device bays (1A-16A and 1B-16B) for profile assignment. On a c3000 enclosure, this feature supports 8 additional or 16 total device bays. (1A-8A and 1B-8B.
When restoring from the configuration file, remote enclosure credentials are lost. See "Recovering remote enclosures (on page 54)." General Settings The Virtual Connect domain name should be unique within the data center, and can be up to 31 characters without spaces or special characters. The Domain Setup Wizard automatically assigns a domain name (enclosurename_vc_domain). This name can be changed when running the setup wizard, or at any time from the Domain Settings (Configuration) screen.
Local Users The first time this screen appears, the Administrator account, which has all administrative privileges, might be the only user listed. The Administrator account cannot be deleted or have domain privileges removed. However, the Administrator password can be changed, and the network, server, and storage privileges can be removed. The default Administrator password is identified on the Default Network Settings label on the primary VC module.
VCM displays confirmation dialog boxes when deleting objects such as server profiles, networks, and so on. These dialog boxes require you to enter the name of the item you want to delete and, in some cases, you must also enter the word "delete." If you enable the Auto Populate Name During Delete option, the confirmation dialog boxes appear with the required information automatically populated, enabling you to simply click OK to proceed with the deletion. This is a domain-wide setting.
User Settings Observe the following user settings guidelines: • Username is a required field. • The Username field must contain an alpha-numeric value with 1 to 31 characters. • The Password field must contain an alpha-numeric value with 3 to 31 characters.
Finish domain wizard Click Finish to complete this wizard, and then run the Network Setup Wizard ("HP Virtual Connect Network Setup Wizard" on page 64) to define the Ethernet networks that will be available within the Virtual Connect domain. Deselect the Start the Network Setup Wizard checkbox, and then click Finish to go to the Home page without running additional setup wizards.
connectivity of servers to the external networks. For more information, see “Supported configurations (on page 14)" and “Recommended stacking connections (on page 21)." NOTE: Virtual Connect does not support stacking for FC modules, so each VC-FC module requires uplink connections to the external FC SAN environment. To initiate this wizard, click the Network Setup Wizard link on the homepage, or select Network Setup Wizard from the Tools pull-down menu.
Always establish control processes to ensure that a unique MAC address range is used in each Virtual Connect domain in the environment. Reusing address ranges could result in server network outages caused by multiple servers having the same MAC addresses.
Select the type and range of MAC address, and then click Next. Selecting VC-assigned MAC address ranges When using VC-assigned MAC addresses, you can choose between using an HP pre-defined MAC address range or using a user-defined MAC address range. • HP pre-defined MAC address range (recommended). These pre-defined ranges are reserved and are not the factory default on any hardware. There are 64 ranges of 1024 unique addresses to choose from. Be sure to use each range only once within a data center.
Server VLAN Tag Settings VLAN tunneling support You can tunnel VLAN tags and map VLAN tags in the same domain. As of VC 3.30, tunneling and mapping is configured at the network level, not at the domain level. Server VLAN tunneling is supported only on networks with dedicated uplinks and cannot be used with shared uplink sets.
mapping VLANs to server connections. When VCM detects that no legacy modules are present in the domain, it enables the selection of a new domain mode that expands the VLAN capacity. The increase in the number of VLANs per domain, in addition to the flexibility of allocating VLANs among the server connections for a physical port, provides you with more options when configuring a Virtual Connect environment.
information on Flex-10, see the HP Virtual Connect for c-Class BladeSystem User Guide on the Installing tab of the HP BladeSystem Technical Resources website (http://www.hp.com/go/bladesystem/documentation).
Define Single Network To define a network: 1. Enter a name for the network that will be easily understood and recognized by the server administrators defining and deploying server profiles. The network name can be up to 64 characters in length (no spaces). 2. To add a color to the network, select a color from the Color pull-down menu. The network color is used as visual identifier for the network within VCM. 3. To add labels to the network, type a label in the Labels field, and then press Enter.
9. In the Network Access Groups field, begin typing the name of a Network Access Group that should include this network. When the Network Access Group name appears, select the name. 10. Click Create Network. For more information on defining networks, see the HP Virtual Connect for c-Class BladeSystem User Guide on the Installing tab of the HP BladeSystem Technical Resources website (http://www.hp.com/go/bladesystem/documentation).
Define Shared Uplink Set Connection To define multiple networks that share a common set of external uplink ports: 1. Enter an overall name for the set of shared uplinks (up to 64 characters, no spaces). 2. From the Add Port list, select the external uplink ports that will carry these networks. To delete a port, click the Delete link in the Action column of the row to delete. 3. Click Add to define the name and VLAN identifier of each network to use these shared uplinks. 4.
8. To use Smart Link, select the Smart Link checkbox. The checkbox is not available until an uplink is added to the shared uplink set. 9. To designate as a private network, select the Private Network checkbox. 10. To set a custom value for the preferred link connection speed or maximum link speed, click Advanced Network Settings. For more information, see "Advanced Network Settings (on page 72)." 11. To create the associated networks, click Create Shared Uplink Set.
Add multiple associated networks: HP Virtual Connect Manager 75
Defined Network Connections This summary screen displays the external connections for each defined network. For more information about the data displayed on this screen, see "Ethernet Networks (External Connections) screen" in the user guide. To define additional networks in the domain, click Create more networks. To complete the Network Setup Wizard, click Done. To view a filtered list of created networks, click Filter, select the criteria, and then click Go. To return to the full list, click X.
To establish external Fibre Channel connectivity: 1. Be sure the Start the Fibre Channel Wizard checkbox is selected. 2. Click Finish. The Fibre Channel Wizard Welcome screen is displayed. To begin deploying server blades: 1. Be sure the Start Fibre Channel Wizard checkbox is not selected. 2. Click Finish. 3. Select Define Server Profile from the homepage.
HP Virtual Connect Fibre Channel Setup Wizard This wizard configures external Fibre Channel connectivity for the HP BladeSystem c-Class enclosure using HP Virtual Connect. A user account with storage privileges is required to perform these operations. Use this wizard to do the following: • Identify WWNs to be used on the server blades deployed within this Virtual Connect domain. • Define fabrics.
Virtual Connect assigns or migrates WWNs for server FC ports connected to HP Virtual Connect modules. Virtual Connect also assigns WWNs to FC ports that are not connected to an I/O module because Virtual Connect modules can be added later. Server FC ports connected to non-Virtual Connect modules retain the server factory default WWNs. Configuring Virtual Connect to assign WWNs in server blades maintains a consistent storage identity (WWN) even when the underlying server hardware is changed.
Assigned WWNs The WWN range used by the Virtual Connect domain must be unique within the environment. HP provides a set of pre-defined ranges that are reserved for use by Virtual Connect and do not conflict with server factory default WWNs. When using the HP-defined WWN ranges, be sure that each range is used only once within the environment. Select the type and range of WWNs, and then click Next.
Define Fabric To define a fabric, select the Define Fabric checkbox, and then click Next. If you do not want to define a fabric at this time, select the I do not want to create SAN Fabrics at this time checkbox, and then click Next.
Define SAN Fabric To define the SAN fabric: 1. Name the fabric. Do not use spaces. 2. Select the uplink ports to be used. Only uplinks on the same bay can be in the same SAN fabric. 3. Change the configuration speed, if preferred. When finished, click Apply. If you are linking to an HP VC FlexFabric 10/Gb/24-Port module, the Advanced button is available. Click Advanced to set the login re-distribution. For more information, see "Login re-distribution (on page 82).
• Automatic Login Re-Distribution—Configures the VC FlexFabric module to automatically initiate login load re-distribution every configured number of seconds if the load becomes unbalanced. The default is manual login re-distribution. The interval is specified by selecting Configure > Fibre Channel Settings, and then selecting the Misc. tab. The interval applies to all fabrics defined with the automatic option, and defaults to 30 seconds.
• Click WWN Settings under Fibre Channel Settings in the left navigation tree of the homepage. • Select Fibre Channel Settings from the Configure pull-down menu. HP Virtual Connect Manager Server Profile Setup Wizard This wizard enables you to setup and configure network/SAN connections for the server blades within the enclosure. Use the wizard to define a server profile template that identifies the server connectivity to use on server blades within the enclosure.
Serial Number Settings Use this screen to assign serial numbers to server blades within the domain. By configuring VCM to assign serial numbers, a profile can present a single serial number regardless of the physical server. With these configuration values added to server profiles, software that is licensed to a particular server, based on one or both of these values, can be migrated to new server hardware without re-licensing the software for the new server hardware.
Create Server Profile Definition Use this screen to create a new server profile definition, which defines and configures Ethernet and Fibre Channel connectivity for the server. For more information on defining a server profile and advanced profile settings, see the HP Virtual Connect for c-Class BladeSystem User Guide on the Installing tab of the HP BladeSystem Technical Resources website (http://www.hp.com/go/bladesystem/documentation).
• If the number of Fibre Channel connections in the profile is more than the number of physical Fibre Channel HBA ports, the profile is assigned, but the connections display a status of “Not mapped” when viewing the profile. • If the number of iSCSI connections in the profile is more than the number of available iSCSI ports on the server, the profile assignment succeeds, but the connections display a status of "Not mapped" when viewing the profile.
• Single enclosure domain HP Virtual Connect Manager 88
• Multi-enclosure domain Name Server Profiles The table displays the automatically generated names that will be assigned to the new server profiles. The server profile name can be up to 64 characters in length (no spaces). Because the server profile can be assigned to different locations, HP recommends that the name reflect the server function. For each enclosure, a base name is provided. You can use this enclosure name to create names for the profiles assigned to the enclosure.
• Single enclosure domain • Multi-enclosure domain Create Server Profiles This screen provides confirmation of each profile that was created and successfully assigned (if applicable).
Click Start Over to create additional profiles using the wizard. This option returns you to the appropriate step for creating more profiles. Click Finish if you are finished creating profiles at this time. This option launches the Virtual Connect Home page. If creation of a server profile failed, see "Server profile troubleshooting (on page 86).
Verify link and speed To verify that all external ports connected to the data center are linked and are operating at the appropriate speed: 1. Verify that all VC-Enet and FlexFabric modules are powered on and functioning properly. The module status LED should be green for all modules connected and configured in Virtual Connect for data center use. If the LED is not green, use the HP Onboard Administrator user interface to diagnose the problem and verify that the module is powered on. 2.
Component identification HP 1/10Gb VC-Enet Module components and LEDs HP 1/10Gb VC-Enet Module components Item Description 1 Port X1 (10GBASE-CX4) 2 Port X2 (10GBASE-CX4) 3 USB 2.
HP 1/10Gb VC-Enet Module LEDs Item Description Status 1 Module locator (UID) Blue = Module ID is selected. Off = Module ID is not selected. 2 Module status Green = Normal operation Amber = Degraded condition Off = Module powered off 3 X1/X2 port status (10GBASE-CX4) Green = Port is configured and operating as an uplink port connected to a data center fabric. Amber = Port is operating as a stacking link interconnecting Virtual Connect Ethernet modules.
HP 1/10Gb VC-Enet Module system maintenance switch Switch Default Function 1 Off Off = Normal operation On = Restore factory default login and DNS information 2 Off Reserved 3 Off Reserved 4 Off Reserved HP 1/10Gb-F VC-Enet Module components and LEDs HP 1/10Gb-F VC-Enet Module components Item Description 1 Port X1 (10GBASE-CX4) 2 Port X2 XFP connector* 3 Port X3 XFP connector* 4 Port S1 SFP connector** 5 Port S2 SFP connector** 6 USB 2.
Item Description 7 Next button 8 Ports 1-4 (10/100/1000BASE-T) 9 Reset button (recessed) * Supports 10GBASE-SR-XFP and 10GBASE-LR-XFP pluggable optical transceiver modules ** Supports 1000BASE-T-SFP and 1000BASE-SX-SFP pluggable optical transceiver modules HP 1/10Gb-F VC-Enet Module LEDs Item LED description Status 1 Module status Green = Normal operation Amber = Degraded condition Off = Power off 2 Module locator (UID) Blue = Module ID selected Off = Module ID not selected 3 X1 port stat
Item LED description Status 8 Port S1/S2 activity Green = Link Green flashing = Activity Off = No link, unsupported or absent pluggable module 9 Port 1-4 port status Green = Port is configured and operating as an uplink port connected to a data center fabric. Amber = Port is operating as a stacking link interconnecting Virtual Connect modules.
HP Virtual Connect Flex-10 10Gb Ethernet Module components and LEDs HP Virtual Connect Flex-10 10Gb Ethernet Module components Item Description 1 Port X1 (10GBASE-CX4), multiplexed with item 4 2 USB 2.
HP Virtual Connect Flex-10 10Gb Ethernet Module LEDs Item LED description Status 1 Module locator (UID) Blue = Module ID is selected. Off = Module ID is not selected. 2 Module status Green = Normal operation Amber = Degraded condition Amber flashing = Fault condition Off = Power off 3 X1 port status (10GBASE-CX4) Green = Port is configured and operating as an uplink port connected to a data center fabric. Amber = Port is operating as a stacking link interconnecting Virtual Connect modules.
Item LED description Status 8 X7/X8 port status Green = Port is configured and operating as an uplink port connected to a data center fabric. Amber = Port is operating as a stacking link interconnecting Virtual Connect modules. Blue = Port locator (PID) Off = Unconfigured 9 X1/X6 port status Green = Port is configured and operating as an uplink port connected to a data center fabric. Amber = Port is operating as a stacking link interconnecting Virtual Connect modules.
HP Virtual Connect Flex-10 10Gb Ethernet Module system maintenance switch Switch Default Function 1 Off Off = Normal operation On = Restore factory default login and DNS information* 2 Off Reserved 3 Off Reserved 4 Off Reserved *See "Resetting the Administrator password and DNS settings (on page 117).
HP Virtual Connect FlexFabric 10Gb/24-port Module components and LEDs HP Virtual Connect FlexFabric 10Gb/24-port Module components Ports X1 through X4 support Ethernet or Fibre Channel traffic. Ports X5 through X8 support Ethernet traffic only. Ports X7 and X8 are multiplexed with the internal 10Gb interface cross-link. Item Description Capable speed 1 — 2 USB 2.
Item LED description Status 1 Module locator (UID) Blue = Module ID is selected. Off = Module ID is not selected. 2 Module status Green = Normal operation Amber = Degraded condition Amber flashing = Fault condition Off = Power off 3 5 7 9 X1-X4 port status Ethernet mode Green = Port is configured and operating as an uplink port connected to a data center fabric. Amber = Port is operating as a stacking link interconnecting Virtual Connect modules.
Item LED description Status 11 13 15 17 X5-X8 port status Green = Port is configured and operating as an uplink port connected to a data center fabric. Amber = Port is operating as a stacking link interconnecting Virtual Connect modules. Amber flashing = SFP module is invalid for Ethernet mode. Purple flashing = Port is configured as a mirror to port.
HP Virtual Connect FlexFabric 10Gb/24-port Module system maintenance switch Switch Default Function 1 Off Off = Normal operation On = Restore factory default login and DNS information* 2 Off Reserved 3 Off Reserved 4 Off Reserved *See "Resetting the Administrator password and DNS settings (on page 117).
HP 4Gb Fibre Channel Module components and LEDs HP 4Gb VC-FC Module components Item Description 1 SFP 2/4 Gb port 1 2 SFP 2/4 Gb port 2 3 SFP 2/4 Gb port 3 4 SFP 2/4 Gb port 4 5 Reset button (recessed) In the default configuration (before a Virtual Connect domain is created), all 2/4 Gb capable uplink ports are grouped into an uplink port group and dynamically distribute connectivity from all 16 server blades.
HP 4Gb VC-FC Module LEDs Item LED description Status 1 Module locator (UID) Blue = Module ID selected Off = Module ID not selected 2 Module status Green = Normal operation Amber = Degraded condition Off = Power off 3 Port Green = Port is configured as the uplink for one or more server HBAs. Blue = Port is selected.
HP 4Gb VC-FC Module system maintenance switch Switch Default Function 1 Off Reserved 2 Off Reserved 3 Off Reserved 4 Off Reserved When part of a Virtual Connect domain, Virtual Connect Manager overrides any system maintenance switch settings.
HP Virtual Connect 4Gb FC Module (with enhanced NPIV) components and LEDs HP Virtual Connect 4Gb FC Module components Item Description Device bays supported in default configuration 1 2/4 Gb capable SFP connectors 1-16 (c7000) 1-8 (c3000) 2 Reset button (recessed) — In the default configuration (before a Virtual Connect domain is created), all 2/4 Gb capable uplink ports are grouped into an Uplink Port Group and dynamically distribute connectivity from all server blades.
HP Virtual Connect 4Gb FC Module LEDs Item LED description Status 1 Module locator (UID) Blue = Module ID selected Off = Module ID not selected 2 Module status Green = Normal operation Amber = Degraded condition Off = Power off 3 Port Green = Port is configured as the uplink for one or more server HBAs. Amber = Port is not configured. Blue = Port is selected.
HP Virtual Connect 4Gb FC Module system maintenance switch Switch Default Function 1 Off Reserved 2 Off Reserved 3 Off Reserved 4 Off Reserved When part of a Virtual Connect domain, Virtual Connect Manager overrides any system maintenance switch settings.
HP Virtual Connect 8Gb 24-Port Fibre Channel Module components and LEDs HP VC 8Gb 24-Port FC Module components Item Description 1 SFP/SFP+ ports supporting 8Gb SFP+ and 1-16 4Gb SFP transceivers Reset button (recessed) — 2 Device bays supported when in default configuration Component identification 112
HP VC 8Gb 24-Port FC Module LEDs Item LED description Status 1 Module locator (UID) Blue = Module ID selected Off = Module ID not selected 2 Module status Green = Normal operation Amber = Degraded condition Off = Power off 3 Port link/activity Green = Port is online, but not passing traffic Green slow flashing = Port is online and not logged in Green flickering = Port is online passing traffic Amber = Port has light or signal, but not yet online Amber slow flashing = Port is disabled (NPIV not e
HP VC 8Gb 24-Port FC Module system maintenance switch Switch Default Function 1 Off Reserved (must be in "Off" position) 2 Off Reserved (must be in "Off" position) 3 Off Reserved (must be in "Off" position) 4 Off Off = Module debug and test interface is inaccessible. On = Module debug and test interface is accessible. When part of a Virtual Connect domain, Virtual Connect Manager overrides any system maintenance switch settings.
HP Virtual Connect 8Gb 20-Port Fibre Channel Module components and LEDs HP VC 8Gb 20-Port FC Module components Item Description 1 SFP/SFP+ ports supporting 8Gb SFP+ and 1-16 (c7000) 4Gb SFP transceivers 1-8 (c3000) 2 Reset button (recessed) Device bays supported in default configuration — In the default configuration, before a Virtual Connect domain is created, all uplink ports are grouped into an uplink port group and dynamically distribute connectivity from all server blades.
Item LED description Status 1 Module locator (UID) Blue = Module ID is selected. Off = Module ID is not selected. 2 Module status Green = Normal operation Amber = Degraded condition Off = Power off 3 Logged in Green = Logged in to an external Fibre Channel switch port Off = Port down, offline, no sync, or error 4 Activity Green flashing (variable) = Link activity Green flashing (1 Hz) = External fabric switch does not support NPIV.
Resetting the Administrator password and DNS settings To return the VC-Enet module to factory default settings for the Administrator password and DNS settings, you must access the system maintenance switch. For switch locations, see the appropriate module system maintenance switch information.
15. Change the Administrator password.
Regulatory compliance notices Regulatory compliance identification numbers For the purpose of regulatory compliance certifications and identification, this product has been assigned a unique regulatory model number. The regulatory model number can be found on the product nameplate label, along with all required approval markings and information. When requesting compliance information for this product, always refer to this regulatory model number.
radio communications. However, there is no guarantee that interference will not occur in a particular installation. If this equipment does cause harmful interference to radio or television reception, which can be determined by turning the equipment off and on, the user is encouraged to try to correct the interference by one or more of the following measures: • Reorient or relocate the receiving antenna. • Increase the separation between the equipment and receiver.
This Class A digital apparatus meets all requirements of the Canadian Interference-Causing Equipment Regulations. Cet appareil numérique de la classe A respecte toutes les exigences du Règlement sur le matériel brouilleur du Canada. Class B equipment This Class B digital apparatus meets all requirements of the Canadian Interference-Causing Equipment Regulations. Cet appareil numérique de la classe B respecte toutes les exigences du Règlement sur le matériel brouilleur du Canada.
This symbol on the product or on its packaging indicates that this product must not be disposed of with your other household waste. Instead, it is your responsibility to dispose of your waste equipment by handing it over to a designated collection point for the recycling of waste electrical and electronic equipment.
Class B equipment Chinese notice Class A equipment Laser compliance This product may be provided with an optical storage device (that is, CD or DVD drive) and/or fiber optic transceiver. Each of these devices contains a laser that is classified as a Class 1 Laser Product in accordance with US FDA regulations and the IEC 60825-1. The product does not emit hazardous laser radiation. Each laser product complies with 21 CFR 1040.10 and 1040.11 except for deviations pursuant to Laser Notice No.
Electrostatic discharge Preventing electrostatic discharge To prevent damaging the system, be aware of the precautions you need to follow when setting up the system or handling parts. A discharge of static electricity from a finger or other conductor may damage system boards or other static-sensitive devices. This type of damage may reduce the life expectancy of the device. To prevent electrostatic damage: • Avoid hand contact by transporting and storing products in static-safe containers.
Support and other resources Before you contact HP Be sure to have the following information available before you call HP: • Active Health System log Download and have available an Active Health System log for 3 days before the failure was detected. For more information, see the HP iLO 4 User Guide or HP Intelligent Provisioning User Guide on the HP website (http://www.hp.com/go/ilo/docs).
providers or service partners) identifies that the repair can be accomplished by the use of a CSR part, HP will ship that part directly to you for replacement. There are two categories of CSR parts: • Mandatory—Parts for which customer self repair is mandatory. If you request HP to replace these parts, you will be charged for the travel and labor costs of this service. • Optional—Parts for which customer self repair is optional. These parts are also designed for customer self repair.
Pour plus d'informations sur le programme CSR de HP, contactez votre Mainteneur Agrée local. Pour plus d'informations sur ce programme en Amérique du Nord, consultez le site Web HP (http://www.hp.com/go/selfrepair). Riparazione da parte del cliente Per abbreviare i tempi di riparazione e garantire una maggiore flessibilità nella sostituzione di parti difettose, i prodotti HP sono realizzati con numerosi componenti che possono essere riparati direttamente dal cliente (CSR, Customer Self Repair).
HINWEIS: Einige Teile sind nicht für Customer Self Repair ausgelegt. Um den Garantieanspruch des Kunden zu erfüllen, muss das Teil von einem HP Servicepartner ersetzt werden. Im illustrierten Teilekatalog sind diese Teile mit „No“ bzw. „Nein“ gekennzeichnet. CSR-Teile werden abhängig von der Verfügbarkeit und vom Lieferziel am folgenden Geschäftstag geliefert. Für bestimmte Standorte ist eine Lieferung am selben Tag oder innerhalb von vier Stunden gegen einen Aufpreis verfügbar.
sustituciones que lleve a cabo el cliente, HP se hará cargo de todos los gastos de envío y devolución de componentes y escogerá la empresa de transporte que se utilice para dicho servicio. Para obtener más información acerca del programa de Reparaciones del propio cliente de HP, póngase en contacto con su proveedor de servicios local. Si está interesado en el programa para Norteamérica, visite la página web de HP siguiente (http://www.hp.com/go/selfrepair).
Opcional – Peças cujo reparo feito pelo cliente é opcional. Essas peças também são projetadas para o reparo feito pelo cliente. No entanto, se desejar que a HP as substitua, pode haver ou não a cobrança de taxa adicional, dependendo do tipo de serviço de garantia destinado ao produto. OBSERVAÇÃO: Algumas peças da HP não são projetadas para o reparo feito pelo cliente. A fim de cumprir a garantia do cliente, a HP exige que um técnico autorizado substitua a peça.
Support and other resources 131
Support and other resources 132
Acronyms and abbreviations BPDU Bridge Protocol Data Unit DAC direct attach cable DHCP Dynamic Host Configuration Protocol DNS domain name system EBIPA Enclosure Bay IP Addressing FC Fibre Channel FCoE Fibre Channel over Ethernet HBA host bus adapter iSCSI Internet Small Computer System Interface LACP Link Aggregation Control Protocol LAG link aggregation group LLDP Link Layer Discovery Protocol Acronyms and abbreviations 133
MAC Media Access Control MIB management information base NPIV N_Port ID Virtualization OA Onboard Administrator POST Power-On Self Test RDP Rapid Deployment Pack SFP small form-factor pluggable SPP HP Service Pack for ProLiant SSL Secure Sockets Layer USB universal serial bus VCDG Virtual Connect Domain Group VCEM Virtual Connect Enterprise Manager VCM Virtual Connect Manager VCSU Virtual Connect Support Utility Acronyms and abbreviations 134
VLAN virtual local-area network WWN World Wide Name XFP 10 Gb small form factor pluggable Acronyms and abbreviations 135
Documentation feedback HP is committed to providing documentation that meets your needs. To help us improve the documentation, send any errors, suggestions, or comments to Documentation Feedback (mailto:docsfeedback@hp.com). Include the document title and part number, version number, or the URL when submitting your feedback.
Index A About menu 54 accessing HP Virtual Connect Manager 10, 51 ActiveX 50 adding enclosures 58 Advanced Network Settings 72 allowing double density device bays 56 assign server profiles 86 assigned MAC addresses 65, 67 assigned WWNs 79 authorized reseller 123 B backup module 10, 13, 25 bay configuration guidelines 17 browser requirements 50 BSMI notice 120 buttons 92 C cables 118 cabling 21, 39 Canadian notice 118 check-pointing 44 Chinese notice 121 Cisco Core switch 42 class A equipment 117 class B e
external port connections, verifying external uplink ports 71, 73 HP Virtual Connect Flex-10 10Gb Ethernet Module 100 HP Virtual Connect Flex-10 10Gb Ethernet Module components and LEDs 97 HP Virtual Connect Flex-10 module, upgrading to 47 HP Virtual Connect FlexFabric 10Gb/24-port Module 104 HP Virtual Connect FlexFabric 10Gb/24-port Module components and LEDs 101 HP Virtual Connect Manager 50 91 F factory default settings 38 failover 13, 54 FC connections 85 FC module bay configuration, multiple enclos
LEDs, HP Virtual Connect FlexFabric 10Gb/24-port Module 101 licensed software and MACs or WWNs 51 local user accounts 61 logging in 53 login distribution 81 loop prevention 24 M MAC address settings 65 modifications, FCC notice 118 module configuration, default 11 module removal and replacement 45 Mozilla support 50 multiple enclosures, adding and importing 58 multiple enclosures, FC module bay configuration 27 multiple enclosures, FlexFabric module bay configuration 27 multiple enclosures, managing 8, 20,
Upgrading to an HP Virtual Connect FlexFabric Module from a VC-FC module 49 user accounts 61 user settings 63 using multiple enclosures 8 V VC domains, directly connecting 29 VC-assigned MAC addresses 67 verify data center connections 90 verify link and speed 91 verify network status 91 Virtual Connect documentation 6 Virtual Connect Manager setup overview Virtual Connect overview 7 VLAN tagging 39, 68 VLAN tunneling, enable or disable 71 11 W website, HP 123 WWN settings 78 WWN, selecting a range 79 X
