53-1002998-01 26 July 2013 752 Fabric Watch Administrator’s Guide Supporting Fabric OS v7.2.
Copyright © 2000, 2002-2013 Brocade Communications Systems, Inc. All Rights Reserved. ADX, AnyIO, Brocade, Brocade Assurance, the B-wing symbol, DCX, Fabric OS, ICX, MLX, MyBrocade, OpenScript, VCS, VDX, and Vyatta are registered trademarks, and HyperEdge, The Effortless Network, and The On-Demand Data Center are trademarks of Brocade Communications Systems, Inc., in the United States and/or in other countries. Other brands, products, or service names mentioned may be trademarks of their respective owners.
Document History Title Publication Number Summary of Changes Date Fabric Watch User’s Guide 53-0001559-02 New document May 2000 Fabric Watch User’s Guide 53-0000186-02 n/a March 2002 Fabric Watch User’s Guide 53-0000504-02 n/a April 2003 Fabric Watch User’s Guide 53-0000524-02 n/a April 2003 Fabric Watch User’s Guide 53-0000524-03 Updated default values and restructured the document.
Title Publication Number Summary of Changes Date Fabric Watch Administrator’s Guide 53-1001770-01 Updates to support Fabric OS v6.4.0: portThConfig, sysMonitor, thConfig, and portFencing commands (recommended for use in configuring class areas instead of the fwConfigure command); recommended class settings added. March 2010 Fabric Watch Administrator’s Guide 53-1002153-01 Updates to support Fabric OS v7.0.0: • Removed deprecated commands: fwconfigure and fwshow. • Removed RAPI trap support.
Contents About This Document How this document is organized . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv Supported hardware and software . . . . . . . . . . . . . . . . . . . . . . . . . . xvi Deprecated hardware platform support. . . . . . . . . . . . . . . . . . . xvi What’s new in this document . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .xvii Document conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .xvii Text formatting . . . . . . . . . .
Threshold monitoring using SNMP tables . . . . . . . . . . . . . . . . . . . . . . 8 MIB capability configuration parameters . . . . . . . . . . . . . . . . . . . 8 Fabric Watch event settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 Fabric Watch notification types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 E-mail alert . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 SNMP traps . . . . . . . . . . . . . . . . . . . . . . .
E-mail notification configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31 Showing e-mail configuration information . . . . . . . . . . . . . . . . . 31 Disabling an e-mail alert . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 Enabling an e-mail alert . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 Sending a test e-mail message. . . . . . . . . . . . . . . . . . . . . . . . . . 32 Setting the recipient e-mail address for an e-mail alert . . . . . .
portThConfig command procedures . . . . . . . . . . . . . . . . . . . . . . . . . 53 Port type: physical port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 E_Port subclass setting guidelines. . . . . . . . . . . . . . . . . . . . . . . 55 E_Port class default settings. . . . . . . . . . . . . . . . . . . . . . . . . . . . 56 FOP_Port and FCU_Port subclass setting guidelines . . . . . . . . 58 FOP_Port and FCU_Port subclass default settings . . . . . . . . . .
Chapter 10 Fabric Watch Reports Fabric Watch reports. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89 Switch Availability Monitor report. . . . . . . . . . . . . . . . . . . . . . . . . . . . 90 Generating a Switch Availability Monitor report. . . . . . . . . . . . . 90 Switch Health report . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91 Generating a Switch Health report . . . . . . . . . . . . . . . . . . . . . . . 91 Switch Status Policy report.
x Fabric Watch Administrator’s Guide 53-1002998-01
Tables Table 1 Fabric Watch classes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 Table 2 Fabric Watch configuration tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 Table 3 Fabric class areas. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 Table 4 Fabric class default settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
xii Fabric Watch Administrator’s Guide 53-1002998-01
Figures Figure 1 In-between buffer values . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 Figure 2 Above event trigger with buffer zone. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 Figure 3 Time base set to none . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Figure 4 Event trigger . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
xiv Fabric Watch Administrator’s Guide 53-1002998-01
About This Document In this chapter • How this document is organized . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv • Supported hardware and software. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xvi • What’s new in this document . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xvii • Document conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xvii • Additional information . . . . . . . . . . . . .
• Chapter 9, “Fabric Watch Configuration Using Web Tools,” provides information about how to use Web Tools to configure Fabric Watch settings, an alternative to using the command line interface. • Chapter 10, “Fabric Watch Reports,” describes the reports available through Fabric Watch and the methods of accessing each report. Supported hardware and software Although many different software and hardware configurations are tested and supported by Brocade Communications Systems, Inc. for Fabric OS 7.2.
What’s new in this document • “Deprecated hardware platform support” on page xvi updated to remove support for the Brocade 8000 switch. • Updated Table 24 on page 70 to remove information about Brocade 8000 default settings for temperature. • Updated “Logical switch support” on page 8. • Added new section “Monitoring the filter performance class” on page 44. Document conventions This section describes text formatting conventions and important notices formats.
CAUTION A Caution statement alerts you to situations that can be potentially hazardous to you or cause damage to hardware, firmware, software, or data. DANGER A Danger statement indicates conditions or situations that can be potentially lethal or extremely hazardous to you. Safety labels are also attached directly to products to warn of these conditions or situations. Key terms For definitions specific to Brocade and Fibre Channel, refer to the Brocade Glossary.
Getting technical help Contact your switch support supplier for hardware, firmware, and software support, including product repairs and part ordering. To expedite your call, have the following information available: 1.
xx Fabric Watch Administrator’s Guide 53-1002998-01
Chapter 1 Fabric Watch In this chapter • Fabric health . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 • Fabric Watch overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 • Role-based access control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 • Fabric Watch licensing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1 Fabric Watch overview Fabric Watch overview Fabric Watch is an optional storage area network (SAN) health monitor that allows you to enable each switch to constantly monitor its SAN fabric for potential faults and automatically alerts you to problems long before they become costly failures. Fabric Watch tracks a variety of SAN fabric elements and events. Monitoring fabric-wide events, ports, and environmental parameters enables early fault detection and isolation as well as performance measurement.
Reasons to customize Fabric Watch settings 1 Universal temporary license support The Fabric Watch license is available as a universal temporary or a regular temporary license, meaning the same license key can be installed on any switch running Fabric OS version 6.3 or later. Universal temporary license keys can only be installed once on a switch, but can be applied to as many switches as required.
1 Class, area, and element hierarchy Time base configuration The time base specifies the time interval between two samples to be compared. The fwSetToCustom command allows you to switch from default to custom settings. Valid intervals are day, hour, or minute. Refer to “Setting Fabric Watch custom and default values” on page 30 for more information.
Switch monitoring components 1 An example of a very simple Class --> Area --> Element hierarchy follows. Port --> Cyclic redundancy check (CRC) -->port 0 For specific information about classes, areas, and elements, refer to Chapter 3, “Fabric Watch Threshold Components”. Switch monitoring components Fabric Watch software enables you to monitor the independent components that are listed in this section.
1 Switch monitoring components Security monitoring The Security class monitors different security violations on the switch and takes action based on the configured thresholds and their actions. You can customize Security class and area parameters using the thConfig command. For complete information about security monitoring, refer to “Security monitoring guidelines and default settings” on page 37.
Switch monitoring components 1 Port fencing A port that is consistently unstable can harm the responsiveness and stability of the entire fabric and diminish the ability of the management platform to control and monitor the switches within the fabric. Port fencing is a Fabric Watch enhancement that takes the ports offline if the user-defined thresholds are exceeded. Supported port types include physical ports, E_Ports, optical F_Ports (FOP_Ports), copper F_Ports (FCU_Ports), and Virtual E_Ports (VE_Ports).
1 Logical switch support Logical switch support Fabric Watch can monitor the switch health on eight logical switches. You can configure thresholds and notifications for ports that belong to a particular logical switch. Each logical switch has its own Fabric Watch configuration and triggers notifications based on its local configuration. Fabric Watch supports port movement from one logical switch to another.
Fabric Watch notification types 1 You must first use the fwSetToCustom command to switch from default to custom settings, and then use the advanced configuration options provided with the portThConfig, thConfig, and sysMonitor commands to configure event behavior, actions, and time bases at the port level. Use the advanced configuration option provided with the portThConfig, thConfig, and sysMonitor commands to view and modify custom and default values for specified classes and areas in Fabric Watch.
1 Fabric Watch notification types An SNMP trap forwards the following information to an SNMP management station: • • • • • • Name of the element whose counter registered an event Class, area, and index number of the threshold that the counter crossed Event type Value of the counter that exceeded the threshold State of the element that triggered the alarm Source of the trap You must configure the software to receive trap information from the network device.
Fabric Watch audit messages 1 Fabric Watch audit messages Fabric Watch events caused by configuration value changes are tagged as Audit messages. When managing SANs you may want to filter or audit certain classes of events to ensure that you can view and generate an audit log for what is happening on a switch, particularly for security-related event changes.
1 Fabric Watch support in Access Gateway mode Fabric Watch support in Access Gateway mode Both the Advanced Performance Monitoring (APM) license and the Fabric Watch license must be installed on the platform configured in Access Gateway (AG) mode to use the frame monitoring and end-to-end (EE) monitoring capabilities. The APM license provides the counters and the Fabric Watch license provides the monitoring and alert mechanisms for these counters.
Chapter 2 Fabric Watch Thresholds In this chapter • Threshold values . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Time bases. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Threshold triggers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Fabric Watch alarm behavior . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2 Threshold triggers In-between buffer values The below high threshold is the term used to configure “in between” buffer values, as shown in Figure 1. In this example, the high threshold value is 5 and the buffer value is 1. Therefore, the “in-between” boundary value is 4. Enter the portThConfig command using the following parameters.
Threshold triggers 2 Above event trigger Set the Above event trigger for an element that requires only high threshold monitoring. In the Above event trigger, Fabric Watch triggers an event immediately after the data value becomes greater than the high threshold. Define a buffer zone within the operational limit of an area to suppress multiple events when the counter value goes above the high threshold and fluctuates around it.
2 Time bases Time bases Time bases specify the time interval between two samples to be compared. You can set the time base to day (samples are compared once a day), hour (samples are compared once an hour), minute (samples are compared every minute). This configurable field affects the comparison of sensor-based data with user-defined threshold values. Time base set to none If you set a time base to none, Fabric Watch compares a data value against a threshold boundary level.
Fabric Watch alarm behavior 2 Figure 4 shows a sample graph of data obtained by Fabric Watch (the type of data is irrelevant to the example). A high threshold of 2 is specified to trigger an event. A time base of minute is defined. An event occurs only if the rate of change in the specific interval (one minute in this example) is across the threshold boundary. It should be either higher than the high threshold limit or lower than the low threshold limit.
2 18 Fabric Watch alarm behavior Fabric Watch Administrator’s Guide 53-1002998-01
Chapter Fabric Watch Threshold Components 3 In this chapter • Fabric Watch classes, areas, and elements . . . . . . . . . . . . . . . . . . . . . . . . . 19 Fabric Watch classes, areas, and elements Fabric Watch uses a hierarchical organization to track the network device information it monitors. There is a class, area, and element associated with every monitored behavior. Classes are the highest level in the system, subdivided into one or more areas. Areas contain one or more elements.
3 Fabric Watch classes, areas, and elements • Chapter 7, “Port Monitoring” The physical port and its subclass areas and actions are configured using the portThConfig command. • Chapter 8, “System Monitoring” The Resource class and Environment class areas and actions are configured using the sysMonitor command. The FRU class actions are configured using the fwFruCfg command Elements Fabric Watch defines an element as any fabric or switch component that the software monitors.
Fabric Watch classes, areas, and elements TABLE 1 3 Fabric Watch classes (Continued) Class Description Performance Monitor Serves as a tuning tool. The Performance Monitor class groups areas that track the source and destination of traffic. Use the Performance Monitor class thresholds and notifications to determine traffic load and flow and to reallocate resources appropriately.
3 22 Fabric Watch classes, areas, and elements Fabric Watch Administrator’s Guide 53-1002998-01
Chapter 4 Fabric Watch Activation In this chapter • Interfaces for activating Fabric Watch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Activating Fabric Watch using a Telnet session. . . . . . . . . . . . . . . . . . . . . . . • Activating Fabric Watch using SNMP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Activating Fabric Watch using Web Tools. . . . . . . . . . . . . . . . . . . . . . . . . . . .
4 Activating Fabric Watch using SNMP 3. Enter the licenseShow command to determine if the Fabric Watch license is installed. switch:admin> licenseshow edzbzQStu4ecS: Fabric Watch license Performance Monitor license Trunking license Full Ports on Demand license - additional 16 port upgrade license If the Fabric Watch license is not listed, continue to step 4; otherwise, you are ready to use Fabric Watch. 4. Enter the license key with the licenseAdd key command, where key is the Fabric Watch license key.
Activating Fabric Watch using SNMP FIGURE 5 4 Configuring Fabric Watch using SNMP In Figure 5, the MIB browser populated the left side of the window with a MIB tree that you can navigate. 3. Open Web Tools and select Tasks > Manage > Switch Admin. 4. Click Show Advanced Mode. 5. On the SNMP tab, enter the IP address of the trap receiver and the severity level, and click Apply. NOTE The severity level must be informational (4) in order to forward threshold alerts. 6.
4 Activating Fabric Watch using SNMP FA-TRAP (yes, y, no, n): [yes] connUnitStatusChange (yes, y, no, n): [no] connUnitEventTrap (yes, y, no, n): [no] connUnitSensorStatusChange (yes, y, no, n): [no] connUnitPortStatusChange (yes, y, no, n): [no] SW-EXTTRAP (yes, y, no, n): [no] 7. Enter the snmpConfig command to configure the SNMP management host IP address. switch:admin> snmpConfig Customizing MIB-II system variables ...
Activating Fabric Watch using SNMP 4 8. Enter the IP address for the switch in the Host field in the MIB browser. Enter the community string in the Community field. To perform set operations, enter the write community in the Write Community field. 9. View and listen for trap details from a MIB browser menu. NOTE Any changes related to Fabric Watch, such as changing the status of the temperature sensor, will generate traps. 10. Expand the tree on the left to find the Fabric Watch OID information.
4 Activating Fabric Watch using Web Tools Activating Fabric Watch using Web Tools You can open Web Tools on any workstation with a compatible Web browser installed. 1. Open the Web browser and type the IP address of the device in the Address field: http://10.77.77.77 or https://10.77.77.77 2. Press Enter. A browser window opens to open Web Tools. A Login dialog box opens. 3. Enter your user name and password. 4. Select a switch from the Fabric Tree and log in if necessary. 5.
Chapter 5 Fabric Watch Configuration In this chapter • Fabric Watch configuration tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Setting Fabric Watch custom and default values . . . . . . . . . . . . . . . . . . . . . • E-mail notification configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Notification configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
5 Setting Fabric Watch custom and default values TABLE 2 Fabric Watch configuration tasks (Continued) Configuration task Command Location of procedure Set the following parameters for port monitoring: • Port type • Area type • Time base • Threshold level • Trigger (boundary level) • Action (notification type) • Buffer • Port fencing portThConfig portFencing Chapter 7, “Port Monitoring”. Set the port persistence time. fwSet --port -persistence “Setting the port persistence time” on page 62.
E-mail notification configuration 5 E-mail notification configuration In environments where it is critical that you are notified about errors quickly, you can use e-mail notifications. With e-mail notifications, you can be notified of serious errors by e-mail or a pager, so you can react quickly. To configure e-mail notifications in a Telnet session, perform the following steps. 1. Enter the fwMailCfg command at the prompt. The fwMailcfg menu displays.
5 E-mail notification configuration Fabric Watch displays e-mail alert information such as: Mail Recipient Information ____________________________________ Email Alert = enabled Mail Recipient = sysadmin@mycompany.com The system returns to the main fwMailCfg menu. Disabling an e-mail alert 1. Enter 2 in the fwMailCfg menu to disable e-mail alerts for a specific class. The Config Show menu displays. 2. Select a class for which Fabric Watch should disable e-mail alerts.
E-mail notification configuration 5 If the e-mail configuration for the class is complete, the following confirmation message displays: Email has been sent If the e-mail configuration for the class is not complete, the following error message displays: Email has not been sent. Check Mail configuration for Environment class! The e-mail address specified in the mail configuration receives a test e-mail message. The system returns to the fwMailCfg menu.
5 Notification configuration Displaying the relay host configuration 1. Enter 6 in the fwMailCfg menu to display the relay host configuration menu. 1 2 3 4 Display Relay Host configuration Set Relay Host IP Remove Relay Host configuration Quit 2. Enter 1 to display the configuration. Removing the relay host configuration 1. Enter 6 in the fwMailCfg menu to display the relay host configuration menu. 1 2 3 4 Display Relay Host configuration Set Relay Host IP Remove Relay Host configuration Quit 2.
Chapter Fabric, Security, SFP, and Performance Monitoring 6 In this chapter • Fabric monitoring guidelines and default settings . . . . . . . . . . . . . . . . . . . . 35 • Security monitoring guidelines and default settings. . . . . . . . . . . . . . . . . . . 37 • SFP monitoring guidelines and default settings . . . . . . . . . . . . . . . . . . . . . . 39 • Performance monitoring guidelines and default settings. . . . . . . . . . . . . . . 41 • thConfig command . . . . . . . . . . . . . . . . . . . .
6 Fabric monitoring guidelines and default settings TABLE 3 Fabric class areas (Continued) Area Description Segmentation changes (SC) Tracks the cumulative number of segmentation changes. Segmentation changes occur because of one of the following: • Zone conflicts. • Incompatible link parameters. During E_Port and VE_Port initialization, ports exchange link parameters, and incompatible parameters result in segmentation. This is a rare event. • Domain conflicts.
Security monitoring guidelines and default settings 6 Fabric class default settings Table 4 provides default settings for areas in the Fabric class.
6 Security monitoring guidelines and default settings TABLE 5 Security class areas Area Description DCC violations (DV) An unauthorized device attempts to log in to a secure fabric. HTTP violations (HV) A browser access request reaches a secure switch from an unauthorized IP address. Illegal commands (IV) Commands permitted only to the primary Fibre Channel Switch (FCS) are executed on another switch.
SFP monitoring guidelines and default settings TABLE 6 6 Security class area default settings (Continued) Area Description Default threshold settings Default alarm settings Threshold state Incompatible security DB (ISB) Monitors incompatible security databases Unit: Violations Time Base: minute Low: 1 High: 2 Buffer: 0 Below: 0 Above: 3 Informative Out_of_range Login violations (LV) Monitors login violations Unit: Violations Time Base: minute Low: 1 High: 2 Buffer: 0 Below: 0 Above: 3 Infor
6 SFP monitoring guidelines and default settings When a port goes offline, the RXP and TXP area values of the SFP become zero. Brocade recommends non-zero low thresholds for RXP and TXP; therefore, Fabric Watch stops monitoring RXP and TXP parameters of the SFP once the port goes offline. SFP class areas Table 7 lists Product Name areas in the SFP class and describes each area.
Performance monitoring guidelines and default settings TABLE 8 6 SFP class default settings (Continued) Area Description Default threshold settings Default alarm settings Threshold state Transmit power (TXP) Monitors transmit power in µWatts Unit: µWatts Time Base: none Low: 0 High: 5000 Buffer: 25 Below: 1 Above: 1 Out_of_range Out_of_range Current Monitors SFP current Unit: mA Time Base: none Low: 0 High: 50 Buffer: 1 Below: 1 Above: 1 Out_of_range Out_of_range Voltage Monitors SFP elec
6 thConfig command Performance monitoring setting guidelines It is recommended that you leave the entire Performance Monitor Class and End-to-End Performance Monitor Class area settings in their default state (no alerts). Performance Monitor class default settings Table 10 provides default settings for areas in the Customer-Defined Performance Monitor class.
thConfig command TABLE 12 6 Configuration options for thConfig command Class name Valid area types Threshold Threshold action Configuration recommendation Fabric ED - Number of E_Ports down FC - Fabric reconfiguration DC - Domain ID changes SC - Segmentation changes ZC - Zone changes FL - Fabric logins Default or Custom1 Default or Custom2 It is recommended that you leave the entire Fabric class in its default state (no alerts).
6 thConfig command NOTE Both the APM license and the Fabric Watch license must be installed on the platform configured in AG mode to use the frame monitoring and EE monitoring capabilities. The APM license provides the counters and the Fabric Watch license provides the monitoring and alert mechanisms for these counters. To set the high threshold of the RX area, enter the thConfig command using the following parameters.
thConfig command 6 • TXP • Power on Hours (Power on Hours is not supported on the 10 Gbps SFP or the QSFP.) Fabric Watch also monitors the Brocade Quad SFP (QSFP) and, as with the 16 Gbps SFP, if configured thresholds are crossed, Fabric Watch generates an SNMP alarm, a RASlog message, and an e-mail alert for the following SFP areas: • • • • Current Voltage Temperature RXP NOTE On core blades, only the 16 Gbps QSFPs can be installed.
6 thConfig command To show the monitoring status of the SFP and QSFP, enter the thMonitor command using the following parameter: switch:admin> thmonitor --show brcdSfp Specifying the 16 Gbps SFP type You can use the sfpType operand to manage the actions and thresholds for the Current, Voltage, RXP, TXP, and Temperature areas of the 16 Gbps SFPs. If you do not provide the SFP type parameters, the existing thresholds and actions of the SFP class are changed to the default.
6 Recommended settings for Fabric, SFP, Performance, and Security classes TABLE 13 SfpType 10GLWL Others 16 Gbps and QSFP configurable SFP types (Continued) Serial number KD N/A Area Temperature (Centigrade) Default Value 90 -5 Voltage (mVoltage) 3600 2970 RXP (uW) 2230 14 TXP (uW) 2230 60 Current (mAmp) 95 10 Temperature (Centigrade) 85 -10 Voltage (mVoltage) 3630 2970 RXP (uW) 5000 0 TXP (uW) 5000 0 50 0 Current (mAmp) Displaying the number of 16 Gbps SFP operational ho
6 Recommended settings for Fabric, SFP, Performance, and Security classes TABLE 14 Recommended settings for Fabric, SFP, Performance, and Security classes E=Error_Log, S=SNMP_Trap, P=Port_LOG_LOCK, M=EMAIL_ALERT, F=Port Fence Unit Time Base Low Thresh High Thresh Buffer Default Below Above X Downs None 0 0 0 X Fabric reconfig X Reconfigs None 0 0 0 X Domain ID changes X DID changes None 0 0 0 X Segmentation X Segmentations None 0 0 0 X Zone changes X Zone changes
Chapter 7 Port Monitoring In this chapter • Port class areas . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Port class guidelines and default settings. . . . . . . . . . . . . . . . . . . . . . . . . . . • Port configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • portThConfig command procedures. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Port fencing . . . . . . . . . . . . . . .
7 Port class guidelines and default settings TABLE 15 Port class areas (Continued) Area Description Sync loss The number of times a synchronization error occurs on the port. Two devices failed to communicate at the same speed. Synchronization errors are always accompanied by a link failure. Loss of synchronization errors frequently occur due to a faulty SFP or cable. Packet loss (VE_Port only) The number of packets routed through a port exceeds the port bandwidth.
Port class guidelines and default settings 7 Physical port setting guidelines It is recommended that you use the default settings listed in Table 16 for most Port class areas. Consider the Port class to be a superset containing the E_Port, FOP_Port, and FCU_Port subclasses. If you make a change to a default setting for an area in the Port class, it applies to all of the subclasses.
7 Port configuration TABLE 16 Port class default settings (Continued) Area Description Default threshold settings Default alarm settings Threshold state Protocol errors (PE) Monitors the number of primitive sequence errors. Unit: Errors Time Base: minute Low: 0 High: 5 Buffer: 0 Below: 0 Above: 0 Informative Out_of_range Received packets (RXP) Monitors receive rate, by percentage.
portThConfig command procedures 7 NOTE The execution of this command is subject to Virtual Fabrics or Admin Domain restrictions that may be in place. Refer to the Fabric OS Command Reference for more information and for details about the portThConfig command. Using the nosave command The nosave command prevents the configuration changes from being saved persistently. This option allows you to make and view changes without overwriting the saved configuration.
7 portThConfig command procedures • Set the buffer setting to 0 (the default is 100). Note that if you do not specify the buffer value, Fabric Watch automatically recalculates the buffer. • Apply the new custom settings so they become effective. 2. Apply the new custom settings so they become effective. switch:admin> portthconfig --apply port -area crc -action cust -thresh_level custom 3. To display the port threshold configuration for the Port class and all areas, use the following command.
portThConfig command procedures 7 To pause the monitoring of a class, area, and port or index, enter the portThConfig command using the following parameters. NOTE You cannot specify all for all classes, but you can specify all for all areas.
7 portThConfig command procedures • Area: Link Reset Set the alarm to fence the port. This prevents a “flapping” E_Port, which could lead to congestion or frame loss. Refer to “Port type: E_Port, FOP_Port, or FCU_Port” on page 61 for instructions. • Area: Class 3 (C3) Discards Unlike the other areas, take a conservative approach for the C3 Discards area. Use the default settings and configure the alarms for Above.
portThConfig command procedures TABLE 17 7 E_Port class default settings (Continued) Area Description Default threshold settings Default alarm settings Threshold state Link loss Monitors the number of link failures. Unit: Errors Time Base: minute Low: 0 High: 500 Buffer: 50 Below: 0 Above: 0 Informative Out_of_range Signal loss Monitors the number of signal loss errors.
7 portThConfig command procedures FOP_Port and FCU_Port subclass setting guidelines FOP_Port and FCU_Port guidelines for the areas listed below represent a more aggressive approach in most areas. NOTE The settings in these subclasses include settings for the host bus adapter (HBA) ports as well as the storage ports.
portThConfig command procedures 7 • Area: Class 3 (C3) Discards Unlike the other areas, take a conservative approach for the C3 Discards area. Use the default settings and configure the alarms for Above. The goal is to locate issues with the device or its infrastructure, so monitor the data to help isolate issues. Port fencing is one of the recommended solutions for isolating issues. • Area: Trunk Utilization The Trunk Utilization area is new; therefore, recommended settings are not yet available.
7 portThConfig command procedures TABLE 18 60 FOP_Port and FCU_Port subclass default settings (Continued) Area Description Default threshold settings Default alarm settings Threshold state Link loss Monitors the number of link failures. Unit: Errors Time Base: minute Low: 0 High: 500 Buffer: 50 Below: 0 Above: 0 Informative Out_of_range Signal loss Monitors the number of signal loss errors.
portThConfig command procedures 7 VE_Port class default settings Table 19 provides default settings (per minute) for areas in the VE_Port class. The VE_Port type is not supported in Access Gateway mode. NOTE Only a subset of areas, shown in Table 19, can be configured for the VE_Port class. When setting VE_Port thresholds for the Packet Loss area, the threshold value accepts up to two decimal points; for example: -value 0.60, as shown in “Packet loss monitoring enhancements on the VE_Port”.
7 Port fencing Setting the port persistence time Port persistence is used to transition a port into a marginal status. Fabric Watch does not record the event until the event persists for a length of time equal to the port persistence time. If the port returns to normal boundaries before the port persistence time elapses, Fabric Watch does not record the event. The port persistent time is measured in seconds and can be configured. Configuring the port persistence time to zero disables this feature.
Port fencing TABLE 20 7 Port fencing class and subclass areas (Continued) Port type Areas supported for port fencing FOP_Ports Cyclic Redundancy Checks (CRC) Invalid Transmission Words (ITW) Link Reset (LR) Protocol Error (PE) State Change (ST) Class 3 Discard Frames (C3TXO) E_Ports EX_Ports Cyclic Redundancy Checks (CRC) Invalid Transmission Words (ITW) Link Reset (LR) Protocol Error (PE) State Change (ST) NOTE The execution of the portFencing command is subject to Virtual Fabrics (VF) or Admin D
7 Port fencing • Moderate (recommended), conservative and aggressive threshold recommendations are provided in Table 21. After selecting the type of thresholds for an environment: - Set the low threshold with an action of ALERT (RASlog, e-mail, SNMP trap). The alert will be triggered whenever the low threshold is exceeded. - Set the high threshold with an action of Fence. The port will be fenced (disabled) whenever the high threshold is detected.
Recommended port configuration settings 7 Port fencing configuration using BNA The Brocade Network Advisor (BNA) management application supports port fencing. Port fencing objects include the SAN, Fabrics, Directors, Switches (physical), Virtual Switches, Ports, as well as Port Types (E_Port, F_Port, and FX_Port). Use port fencing to directly assign a threshold to these objects. When a switch does not support port fencing, a “No Fencing Changes” message displays in the Threshold field in the Ports table.
7 Recommended port configuration settings TABLE 22 Recommended configuration for the Port class E=Error_Log, S=SNMP_Trap, P=Port_LOG_LOCK, M=EMAIL_ALERT, pf=Port Fence Low Thresh High Thresh Buffer Default Minute 0 500 50 X Sync Loss X Errors Minute 0 500 50 X Signal Loss X Errors Minute 0 5 0 X Protocol Error X Errors Minute 0 5 0 X E_Port Invalid Words X Errors Minute 0 25 0 X E Invalid CRCs X Errors Minute 0 5 0 X E RX Performance X Percentage Mi
7 Recommended port configuration settings TABLE 22 Recommended configuration for the Port class (Continued) E=Error_Log, S=SNMP_Trap, P=Port_LOG_LOCK, M=EMAIL_ALERT, pf=Port Fence High Thresh Buffer 0 15 0 X E,S Sync Loss X Errors Minute 0 45 0 X E,S HOST Signal Loss X Errors Minute 0 45 0 X E,S Notes Low Thresh Minute Above Time Base Errors Below Unit X Custom Custom Link Loss Default Area FOP_Port and FCU_Port Default Class Trait Configuration Protocol Error
7 68 Recommended port configuration settings Fabric Watch Administrator’s Guide 53-1002998-01
Chapter 8 System Monitoring In this chapter • Environment monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Resource class settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • System monitoring using the sysMonitor command . . . . . . . . . . . . . . . . . . . • Recommended environment and resource monitoring settings . . . . . . . . . • Switch monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
8 Resource class settings Environment class default settings Table 24 provides default Environment class settings for the Temperature area. Check the appropriate hardware reference manual for differences in actual environmental requirements. The temperature sensors monitor the switch temperature in Celsius. NOTE Fabric Watch no longer supports fan monitoring. Event Manager (EM) now manages fan monitoring and the switch status is calculated based on the fan status reported by EM.
System monitoring using the sysMonitor command TABLE 25 8 Resource class area Area Description Flash Monitors the compact flash space available by calculating the percentage of flash space consumed and comparing it with the configured high threshold value. Resource class default settings Table 26 provides default settings for areas in the Resource class.
8 Examples of the sysMonitor command System monitoring is disabled by default. You must run both the --config -mem and the --config -cpu commands to enable both memory and CPU system monitoring. Using the nosave command The nosave command prevents the configuration changes from being saved persistently. This option allows you to make and view changes without overwriting the saved configuration. CAUTION When you use --config with the --nosave option and the switch reboots, your changes are lost.
Examples of the sysMonitor command 8 2. Apply the changes: switch:admin> sysmonitor --apply env -area temp -action_level cust -thresh_level cust Resource class settings The flash area of the Resource class monitors the percentage of compact flash memory used on the system.
8 Recommended environment and resource monitoring settings Displaying the current CPU usage threshold Enter the sysMonitor command using the following parameters: switch:admin> sysmonitor --show cpu CPU Usage : 2% CPU Usage Limit : 75% Number of Retries :3 Polling Interval : 120 seconds Actions: snmp Displaying the current memory usage threshold Enter the sysMonitor command using the following parameters: switch:admin> sysmonitor --show mem Used Memory: 171476k 34% Total Memory: 504344k Free Memory: 3328
Switch monitoring 8 Switch monitoring Before entering the switchStatusPolicySet command, plan your switch status policy. Determine your system requirements and the factors that affect its monitors. NOTE Based on the configuration of the core blade component of the switch status policy, Fabric Watch generates two RASlogs when a core blade is removed either on the Brocade DCX or the Brocade DCX-4S.
8 Switch monitoring Brocade DCX 8510-8 default policy The default Fabric Watch policy for the Brocade DCX 8510-8 with total power consumption of more than 2,000 watts does not properly reflect the switch status on the power supply. Fabric Watch users must manually update the default configuration for the minimum number of power supplies to three if they have installed more than 256 ports in a DCX 8510-8 chassis.
FRU monitoring • • • • 8 Temperature—Temperature thresholds detect faulty temperature sensors. Fan—Fan thresholds detect faulty fans. Flash—Flash thresholds monitor flash memory. Marginal Ports—Ports that move into the marginal state for reasons such as insufficient buffer credits. • Port Persistence Time—Fabric Watch waits for the port persistence time duration before it declares the port to be in the MARGINAL state when it crosses the high threshold.
8 FRU monitoring NOTE The Off state is applicable only to fans on some platforms, such as the Brocade DCX and Brocade DCX-4S. The Off state is not applicable to the power supply, slot, or WWN FRUs. 1. Establish a Telnet connection with a switch. 2. Log in using administrative privileges. 3. Enter the fwFruCfg command at the command prompt. The fwFruCfg command displays your current FRU configuration. The types of FRUs are different for the various platforms. 4.
FRU monitoring 8 For example, to trigger events using the Absent, Off, and Faulty states, add the assigned values and enter that value at the prompt. In this case, the values are 1, 8, and 16, respectively, and the total is 25. Recommended FRU settings Table 30 lists the recommended settings for field-replaceable units (FRUs).
8 80 FRU monitoring 53-1002998-01 Fabric Watch Administrator’s Guide
Chapter Fabric Watch Configuration Using Web Tools 9 In this chapter • Using Web Tools to configure Fabric Watch. . . . . . . . . . . . . . . . . . . . . . . . . . 81 Using Web Tools to configure Fabric Watch You can use Web Tools to define the following Fabric Watch configurations: • Configure custom threshold values on particular elements. • Place limits on the acceptable values of those elements and enable the custom limits (configure threshold boundaries).
9 Using Web Tools to configure Fabric Watch FIGURE 7 Fabric Watch window The Fabric Watch Explorer pane, on the left side of the window, displays the available classes. Not all classes are available for all switches. The status bar at the bottom of the window provides you with a summary of recent actions, and the date and time the module was last updated. System monitoring using Web Tools The Fabric Watch license must be installed to view and modify the System Monitor details.
Using Web Tools to configure Fabric Watch 9 Fabric Watch threshold configuration using Web Tools The Threshold Configuration tab enables you to configure event conditions. From this tab, you configure threshold traits, alarms, and e-mail configurations. NOTE Use the procedures in this section to configure threshold traits for all classes except for the FRU class. Use the procedure described in “Configuring alarms for FRUs using Web Tools” on page 85 for the FRU class.
9 Using Web Tools to configure Fabric Watch Configuring threshold alarms After you update the threshold information, use the Alarm Configuration subtab to customize the notification settings for each event setting.
Using Web Tools to configure Fabric Watch 9 • SNMP_TRAP • PORT_LOG_LOCK • EMAIL_ALERT 7. Click Apply. Enabling or disabling threshold alarms for individual elements To configure element-specific alarm settings, perform the following steps. 1. Open the Fabric Watch window. 2. In the Fabric Watch Explorer pane, select a class. You can set alarms for information on a switch only if that information is monitored by Fabric Watch for that switch; not all alarm options are available for all switches. 3.
9 Using Web Tools to configure Fabric Watch If a FRU of the selected type is determined that it is one of the selected states, an event will occur. 6. Select the methods by which you want to be notified about the FRU alarms. For FRUs, the only options are error log and e-mail alert. 7. Click Apply to apply the changes to the switch. A confirmation dialog box displays, asking if you want to apply the changes to the switch. 8. Click OK to save the changes to the switch.
Using Web Tools to configure Fabric Watch 9 Displaying alarms Using the Alarm Notification tab, you can view a list of all alarms that occurred for a selected class or area (Figure 7 on page 82). Table 31 describes the columns in this report. You can click the header of each column to change the way the information is sorted in your view. You can also right-click the column header and select sort options from a menu. NOTE For the FRU class, only the Name, State, and Time columns are displayed.
9 Using Web Tools to configure Fabric Watch 5. In the Domain Name field, enter the domain name (between 4 and 32 characters). 6. Click Apply. Enabling the e-mail alert You can set a different e-mail alert configuration for each FRU class. For example, you can set one e-mail notification for SFPs and another for E_Ports. Before configuring e-mail alert recipients, you must set up the e-mail notification recipient’s DNS server and domain name.
Chapter 10 Fabric Watch Reports In this chapter • Fabric Watch reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Switch Availability Monitor report . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Switch Health report . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Switch Status Policy report . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Port Detail report . . .
10 Switch Availability Monitor report Switch Availability Monitor report The Switch Availability Monitor (SAM) report lets you see the uptime and downtime for each port. It also enables you to check if a particular port is failing more often than the others. NOTE SAM report details do not display the health status of GbE ports. Fabric Watch only monitors and reports the status for physical and virtual FC ports. You can run reporting commands in Fabric Watch to get instant access to switch information.
Switch Health report 10 Switch Health report The Switch Health report lists the following information: • Current health of each port, based on the currently configured policy settings. • High-level state of the switch, the power supplies, and temperature monitor. • All ports that are in an abnormal state and the current health state of each port. The switch health report is available even without Fabric Watch, but for licensed Fabric Watch users, the marginal and faulty ports are included in the report.
10 Port Detail report Generating a Switch Status Policy report 1. Connect to the switch and log in as admin. 2. Enter the switchStatusPolicyShow command to generate a Switch Status Policy report. The current overall switch status policy parameters: PowerSupplies Temperatures Fans Flash MarginalPorts FaultyPorts MissingSFPs ErrorPorts Number of Ports: Down 2 2 2 0 6.15% 16.50% 20.00% 20.10% 512 Marginal 1 1 1 1 2.25% 12.19% 10.89% 20.
10 Port Detail report 085 U OFFLINE 086 U OFFLINE 087 F HEALTHY 088 F HEALTHY 089 U OFFLINE 090 U OFFLINE 091 U OFFLINE 092 U OFFLINE 093 U OFFLINE 094 U OFFLINE 095 DP OFFLINE 208 G HEALTHY 209 G HEALTHY 210 G HEALTHY 211 G HEALTHY 212 G HEALTHY 213 G HEALTHY 214 G HEALTHY 215 G HEALTHY 216 VE HEALTHY 217 VE HEALTHY (output truncated) 062:17 062:17 062:17 062:17 062:17 062:17 062:17 062:17 062:17 062:17 062:17 000:00 000:00 000:00 000:00 000:00 000:00 000:00 000:00 061:19 061:19 - - - - - - - -
10 94 Port Detail report Fabric Watch Administrator’s Guide 53-1002998-01
Index A C above event triggers, 15 access gateway mode, restrictions in Fabric Watch, 12 action configuration guidelines, 4 activating Fabric Watch, 23, 81 using a Telnet session, 23 using SNMP, 24 using Web Tools, 28 alarm behavior, 17 alarm configuration report for Fabric Watch, 86 alarm notification configuration, 34 alarms, Fabric Watch configuring, 84, 85 displaying, 87 enabling and disabling, 85 alerts configuration recommendations, 3 area environment class, 69 fabric class, 35 FRU class, 77 perfor
D data values, 11 default settings E_Port, 56 environment class, 70 Fabric class, 37 FOP_Port and FCU_Port, 59 performance monitor class default settings, 42 port class, 51 VE_Port, 61 disabling Fabric Watch threshold alarms, 85 displaying alarms, Fabric Watch, 87 E E_Port default settings, 56 E_Port setting guidelines, 55 e-mail alert, 9 how to disable, 32 how to enable, 32 setting recipient e-mail address, 33 e-mail notification configuration, 30 email notifications, 87 e-mail, testing a message, 32 enab
FRU class areas, 77 configuration, 77 recommended settings, 79 specifying triggers for alarms, 78 FRU configuration, 30 FRU monitoring, 77 I interface types, 23 invalid CRC area, configuring, 53 IP address, setting for notification, 33 L licenseAdd key command, 24 locked port log notification type, 10 M management information base (MIB), 8 memory configuration limits, 73 configuring the usage threshold, 74 MIBs, using remotely, 8 monitoring customizing settings, 4 fabric events, 5 fabric setting guidelin
relay host configuration displaying, 34 removing, 34 setting, 33 resource class area, 70 default settings, 71 recommended settings, 74 resource class area, 70 S security class areas, 37 security monitoring, 6 recommended settings, 47 setting time base, 16 settings, customizing, 3 SFP support for 10 Gbps and 16 Gbps, 6 SFP class monitoring guidelines, 39 SFP monitoring, 6 recommended settings, 47 SNMP components of, 8 using to activate Fabric Watch, 24 switch monitoring components, 5 switch policies, 7 swit
