ServerNet Cluster 6780 Planning and Installation Guide (G06.28+, H06.05+)
Table Of Contents
- What’s New in This Guide
- About This Guide
- 1 ServerNet Cluster Overview
- 2 ServerNet Cluster Hardware Description
- 3 Planning for Installation and Migration
- Planning Checklist
- Software Installation Planning
- Hardware Installation and Migration Planning
- Task 1: Plan for the ServerNet Nodes
- Task 2: Plan for the System Consoles
- Task 3: Plan for the 6780 Switches
- Task 4: Plan for the Racks
- Task 5: Plan for the Power Requirements
- Task 6: Plan the Location of the Hardware
- Task 7: Plan for the Fiber-Optic Cables
- Task 8: Plan to Migrate the ServerNet Nodes From 6770 Switches
- Task 9: Plan the ServerNet Node Numbers
- Task 10: Plan the Expand-Over-ServerNet Lines
- Migration Examples
- 4 Preparing a System for Installation or Migration
- 5 Installing 6780 Switches
- 6 Connecting the Fiber-Optic Cables
- Summary of Tasks
- Handling the Fiber-Optic Cables
- Connecting the Layer Cables
- Connecting the Zone Cables
- Connecting the Cables Between a Node and a 6780 Switch
- Alerts
- Task 1: Double-Check the Required Software and Hardware
- Task 2: Label the Cables That Connect to the Node
- Task 3: Inspect the Cables
- Task 4: Connect a Cable to the Switch
- Task 5: Connect a Cable to the Node
- Task 6: Check the Link-Alive LEDs
- Task 7: Check Operations
- Task 8: Finish Connecting the Fiber-Optic Cables
- Routing the Fiber-Optic Cables
- 7 Configuring Expand-Over-ServerNet Lines
- Using Automatic Line-Handler Generation
- Using the OSM Service Connection
- Using SCF
- Rule 1: Configure the Primary and Backup Line-Handler Processes in Different Processor Enclosures
- Rule 2: For Nodes With 6 or More Processors, Avoid Configuring the Line-Handler Processes in Proc...
- Rule 3: For Nodes With More Than 10 Processors, Avoid Configuring the Line-Handler Processes in P...
- Expand-Over-ServerNet Line-Handler Process Example
- 8 Checking Operations
- Checking the Operation of the ServerNet Cluster
- Checking the Operation of Each Switch
- Checking the Power to Each Switch
- Checking the Switch Components
- Checking the Numeric Selector Setting
- Checking the Globally Unique ID (GUID)
- Checking for a Mixed Globally Unique ID (GUID)
- Checking the Fiber-Optic Cable Connections to the Switch Port
- Checking the Switch Configuration, Firmware, and FPGA Images
- Checking the Operation of Each Node
- Checking the Service Processor (SP) Firmware
- Checking That Automatic Line-Handler Generation Is Enabled
- Checking the ServerNet Node Numbers
- Checking MSGMON, SANMAN, and SNETMON
- Checking for Alarms on Each Node
- Checking the ServerNet Cluster Subsystem
- Checking That the ServerNet Node Numbers Are Consistent
- Checking Communications Between a Local Node and a Switch
- Checking Communications With a Remote Node
- Checking the Internal ServerNet X and Y Fabrics
- Checking the Operation of Expand Processes and Lines
- 9 Changing a ServerNet Cluster
- OSM Actions
- Removing a Node From a ServerNet Cluster
- Removing Switches From a ServerNet Cluster
- Adding a Node to a ServerNet Cluster
- Adding a Switch Layer to a ServerNet Cluster
- Adding a Switch Zone to a ServerNet Cluster
- Task 1: Prepare to Add the Switches
- Task 2: Connect the Cables Between Layers
- Task 3: Check Operations
- Task 4: Disconnect the Cables Between Zones
- Task 5: Connect the Cables Between Zones
- Task 6: Check Operations
- Task 7: Connect the Additional Nodes
- Task 8: Check Operations
- Task 9: Repeat Tasks 2 Through 8 for the Other Fabric
- Task 10: Reenable OSM Alarms
- Moving a Node
- Changing the Hardware in a Node Connected to a ServerNet Cluster
- 10 Troubleshooting
- Symptoms
- Recovery Operations
- Enabling Automatic Expand-Over-ServerNet Line-Handler Generation
- Reseating a Fiber-Optic Cable
- Correcting a Mixed Globally Unique ID (GUID)
- Restoring Connectivity to a Node
- Switching the SANMAN Primary and Backup Processes
- Switching the SNETMON Primary and Backup Processes
- Configuring the Expand-Over-ServerNet Line-Handler Processes and Lines
- Starting Required Processes and Subsystems
- Fallback Procedures
- 11 Starting and Stopping ServerNet Cluster Processes and Subsystems
- A Part Numbers
- B Blank Planning Forms
- C ESD Guidelines
- D Specifications
- E Configuring MSGMON, SANMAN, and SNETMON
- F Updating the 6780 Switch Logic Board Firmware, Configuration, and FPGA Images
- G Using the Long-Distance Option
- Safety and Compliance
- Glossary
- Index

Contents
ServerNet Cluster 6780 Planning and Installation Guide—527301-005
ix
Safety and Compliance
Safety and Compliance
Glossary
Index
Figures
Figure 1-1. Layered Topology (Two Zones and Two Layers) 1-5
Figure 1-2. Message Passing Over ServerNet 1-7
Figure 2-1. Components in the Front of a 6780 Switch 2-5
Figure 2-2. Plug-In Cards 2-6
Figure 2-3. 6780 Switch Ports on a Dual SMF or Quad MMF PIC 2-8
Figure 2-4. Logic Board Front Panel 2-10
Figure 2-5. ServerNet Node Numbers in a Layered Topology (One Fabric
Shown) 2-19
Figure 2-6. NNA FPGA PIC Installed in Port 6 2-21
Figure 2-7. Duplex SC Connector and Receptacle for MSEB Connections 2-22
Figure 2-8. 6780 Switch LEDs 2-24
Figure 2-9. MSEB LEDs 2-25
Figure 2-10. Fiber-Optic Links 2-26
Figure 2-11. Duplex LC Connectors 2-28
Figure 2-12. Duplex SC Connectors for MSEB 2-28
Figure 3-1. Ethernet LAN Serving Multiple Nodes 3-7
Figure 3-2. Before the Migration: Tri-Star Topology 3-22
Figure 3-3. After the Migration: Example of Upgrading to a Layered Topology 3-24
Figure 3-4. After the Migration 3-25
Figure 4-1. Slots 51 and 52 for NonStop S-Series Processor Enclosure 4-7
Figure 4-2.
Modular ServerNet Expansion Board (MSEB) 4-8
Figure 4-3.
SEB and MSEB Connectors (Actual Size) 4-9
Figure 4-4. Comparison of an NNA PIC and ECL PIC 4-10
Figure 6-1. Cable Connections Between Two Layers 6-5
Figure 6-2. Cable Connections for Three Layers 6-6
Figure 6-3. Cable Connections for Four Layers 6-7
Figure 6-4. Cable Connections for a Two-Zone ServerNet Cluster 6-11
Figure 6-5. Cable Connections for a Three-Zone ServerNet Cluster 6-14
Figure 6-6. Inserting a Fiber-Optic Cable Connector Into an MSEB
Receptacle 6-21
Figure 6-7. Effect of Uneven Fiber Insertion on Link Alive 6-21
Figure 9-1. Disconnecting Cables 9-10
Figure 9-2. Cable Connections to Zone 3 9-12