53-1002752-01 14 December 2012 752 Fabric Watch Administrator’s Guide Supporting Fabric OS v7.1.
Copyright © 2000, 2002-2012 Brocade Communications Systems, Inc. All Rights Reserved. Brocade, the B-wing symbol, BigIron, DCX, Fabric OS, FastIron, NetIron, SAN Health, ServerIron, and TurboIron are registered trademarks, and AnyIO, Brocade Assurance, Brocade NET Health, Brocade One, CloudPlex, MLX, VCS, VDX, and When the Mission Is Critical, the Network Is Brocade are trademarks of Brocade Communications Systems, Inc., in the United States and/or in other countries.
Document History Title Publication Number Summary of Changes Date Fabric Watch User’s Guide 53-0001559-02 New document May 2000 Fabric Watch User’s Guide 53-0000186-02 n/a March 2002 Fabric Watch User’s Guide 53-0000504-02 n/a April 2003 Fabric Watch User’s Guide 53-0000524-02 n/a April 2003 Fabric Watch User’s Guide 53-0000524-03 Updated default values and restructured the document.
Title Publication Number Summary of Changes Date Fabric Watch Administrator’s Guide 53-1001770-01 Updates to support Fabric OS v6.4.0: portThConfig, sysMonitor, thConfig, and portFencing commands (recommended for use in configuring class areas instead of the fwConfigure command); recommended class settings added. March 2010 Fabric Watch Administrator’s Guide 53-1002153-01 Updates to support Fabric OS v7.0.0: Removed deprecated commands: fwconfigure and fwshow. • Removed RAPI trap support.
Contents About This Document In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv How this document is organized . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv Supported hardware and software . . . . . . . . . . . . . . . . . . . . . . . . . . xvi Deprecated hardware platform support. . . . . . . . . . . . . . . . . . . xvi What’s new in this document . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xvi New information. . . . . .
Switch monitoring components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 Fabric events monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 Performance monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 Security monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 SFP monitoring. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 Port monitoring . . . . . . . . . . . . . . . . . .
Interfaces for activating Fabric Watch . . . . . . . . . . . . . . . . . . . . . . . . 23 Activating Fabric Watch using a Telnet session . . . . . . . . . . . . . 23 Activating Fabric Watch using SNMP . . . . . . . . . . . . . . . . . . . . . 24 Activating Fabric Watch using Web Tools . . . . . . . . . . . . . . . . . . 28 Chapter 5 Fabric Watch Configuration In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 Fabric Watch configuration tasks. . . . . .
Port class areas. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55 Port class guidelines and default settings . . . . . . . . . . . . . . . . . . . . 56 Physical port setting guidelines . . . . . . . . . . . . . . . . . . . . . . . . . 57 Port class default settings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 Port configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 Custom port settings . . . . . . . . . . . .
Chapter 9 Fabric Watch Configuration Using Web Tools In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87 Fabric Watch Configuration Using Web Tools . . . . . . . . . . . . . . . . . . 87 Opening the Fabric Watch window . . . . . . . . . . . . . . . . . . . . . . . 87 System Monitoring using Web Tools . . . . . . . . . . . . . . . . . . . . . . 88 Fabric Watch threshold configuration using Web Tools . . . . . .
x Fabric Watch Administrator’s Guide 53-1002752-01
Tables Table 1 Fabric Watch classes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 Table 2 Fabric Watch configuration tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 Table 3 Fabric class areas. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 Table 4 Fabric class default settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
xii Fabric Watch Administrator’s Guide 53-1002752-01
Figures Figure 1 In-between buffer values . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 Figure 2 Above event trigger with buffer zone. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 Figure 3 Time base set to none . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Figure 4 Event trigger . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
xiv Fabric Watch Administrator’s Guide 53-1002752-01
About This Document In this chapter • How this document is organized . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Supported hardware and software. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • What’s new in this document . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Document conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Additional information . . . . . . . . . . . . . . . . . . . . .
What’s new in this document • Chapter 8, “System Monitoring,” describes how to configure system memory and CPU values using the sysMonitor command. This chapter also lists the switch status policy factors that affect the health of the switch, describes how to set and view switch status policies, and details how to configure FRUs.
What’s new in this document New information • Added information about the four threshold types: above high threshold, below high threshold, above low threshold, and below low threshold. • Added information about the thMonitor command, which supports the SFP class. • Added information about 10 Gbps, 16 Gbps and QSFP SFP support, including the new sfpType operand. • Added information about how the fwMailCfg command now supports multiple e-mail recipients.
What’s new in this document italic text Provides emphasis Identifies variables Identifies paths and Internet addresses Identifies document titles code text Identifies CLI output Identifies syntax examples For readability, command names in the narrative portions of this guide are presented in mixed lettercase: for example, switchShow. In actual examples, command lettercase is often all lowercase. Otherwise, this manual specifically notes those cases in which a command is case sensitive.
What’s new in this document Additional information This section lists additional Brocade and industry-specific documentation that you might find helpful. To get up-to-the-minute information, go to http://my.brocade.com to register at no cost for a user ID and password. White papers, online demonstrations, and data sheets are available through the Brocade website at: http://www.brocade.com/products-solutions/products/index.page For additional Brocade documentation, visit the Brocade website: http://www.
What’s new in this document 2. Switch Serial Number The switch serial number and corresponding bar code are provided on the serial number label. For specific serial number locations, refer to the Brocade 6520 Hardware Reference Manual. 3. World Wide Name (WWN) Use the licenseIdShow command to display the WWN of the chassis. If you cannot use the licenseIdShow command because the switch is inoperable, you can get the WWN from the same place as the serial number, except for the Brocade DCX.
Chapter 1 Fabric Watch In this chapter • Fabric health . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 • Fabric Watch overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 • Role-based access control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 • Fabric Watch licensing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1 Fabric Watch overview Fabric Watch overview Fabric Watch is an optional storage area network (SAN) health monitor that allows you to enable each switch to constantly monitor its SAN fabric for potential faults and automatically alerts you to problems long before they become costly failures. Fabric Watch tracks a variety of SAN fabric elements and events. Monitoring fabric-wide events, ports, and environmental parameters enables early fault detection and isolation as well as performance measurement.
Reasons to customize Fabric Watch settings 1 Universal temporary license support The Fabric Watch license is available as a Universal Temporary or a regular temporary license, meaning the same license key can be installed on any switch running Fabric OS version 6.3 or later. Universal temporary license keys can only be installed once on a switch, but can be applied to as many switches as required.
1 Reasons to customize Fabric Watch settings Time base configuration The time base specifies the time interval between two samples to be compared. The fwSetToCustom command allows you to switch from default to custom settings. Valid intervals are day, hour, or minute. See “Setting Fabric Watch custom and default values” on page 31 for more information.
Class, area, and element hierarchy 1 Class, area, and element hierarchy Fabric elements and events are organized in a hierarchy by class, area, and element. There is a class, area, and element associated with every monitored behavior. Classes are the highest level in the system, subdivided into one or more areas. Areas contain one or more elements. An example of a very simple Class --> Area --> Element hierarchy follows.
1 Switch monitoring components The Performance Monitor class is divided into the following areas: • EE (end-to-end) Performance Monitor - Monitors RX and TX performance between two devices. • Filter Performance Monitor - Measures the number of frames transmitted through a port that match specific values in the first 64 bytes of the frame.
Switch monitoring components 1 For complete information about port monitoring, including configuration examples, port setting guidelines, and default settings, refer to “Port Monitoring” on page 55. Port persistence The data collected in port monitoring can vary a great deal over short time periods. Therefore, the port can become a source of frequent event messages (the data can exceed the threshold range and return to a value within the threshold range).
1 Logical switch support Switch policies Switch policies are a series of rules that define specific health states for the overall switch. Fabric OS interacts with Fabric Watch using these policies. Each rule defines the number of types of errors that transitions the overall switch state into a state that is not healthy. For example, you can specify a switch policy so that if a switch has two port failures, it is considered to be in a marginal state; if it has four failures, it is in a down state.
Fabric Watch event settings 1 MIB capability configuration parameters The mibCapability option turns certain MIBs and associated SNMP traps on or off. If a specific MIB is disabled, the corresponding traps are also disabled. If any trap group is disabled, the corresponding individual traps are also disabled.
1 Fabric Watch notification types Enabling e-mail alerts for the Changed threshold state in several areas can quickly result in a significant amount of e-mail. Fabric Watch discards e-mail alerts when more than 100 are generated within a minute, which minimizes memory use. SNMP traps In environments where you have a high number of messages coming from a variety of switches, you might want to receive them in a single location and view them using a graphical user interface (GUI).
Fabric Watch audit messages 1 Locked port log Following an event, the port log locks to retain detailed information about an event, preventing the information from being overwritten as the log becomes full. This notification audit stores event information but does not actively send alerts, which is done automatically when some thresholds are exceeded and an alert is triggered. For more information about locking, unlocking, and clearing the port log, see the Fabric OS Command Reference.
1 Fabric Watch support in Access Gateway mode Time bases specify the time interval between two samples to be compared. You can set the time base to day (samples are compared once a day), hour (samples are compared once an hour), or minute (samples are compared every minute). Second samples are not advisable. This configurable field affects the comparison of sensor-based data with user-defined threshold values. See “Time bases” on page 16 for more information.
Chapter 2 Fabric Watch Thresholds In this chapter • Threshold values . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Time bases. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Threshold triggers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Fabric Watch alarm behavior . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2 Threshold triggers In-between buffer values The below high threshold is the term used to configure “in between” buffer values, as shown in Figure 1. In this example, the high threshold value is 5 and the buffer value is 1. Therefore, the “in-between” boundary value is 4. Enter the portThConfig command using the following parameters.
Threshold triggers 2 Above event trigger Set the Above event trigger for an element that requires only high threshold monitoring. In the Above event trigger, Fabric Watch triggers an event immediately after the data value becomes greater than the high threshold. Define a buffer zone within the operational limit of an area to suppress multiple events when the counter value goes above the high threshold and fluctuates around it.
2 Time bases Time bases Time bases specify the time interval between two samples to be compared. You can set the time base to day (samples are compared once a day), hour (samples are compared once an hour), minute (samples are compared every minute). This configurable field affects the comparison of sensor-based data with user-defined threshold values. Time base set to none If you set a time base to none, Fabric Watch compares a data value against a threshold boundary level.
Fabric Watch alarm behavior 2 Figure 4 shows a sample graph of data obtained by Fabric Watch (the type of data is irrelevant to the example). A high threshold of 2 is specified to trigger an event. A time base of minute is defined. An event occurs only if the rate of change in the specific interval (one minute in this example) is across the threshold boundary. It should be either higher than the high threshold limit or lower than the low threshold limit.
2 18 Fabric Watch alarm behavior Fabric Watch Administrator’s Guide 53-1002752-01
Chapter Fabric Watch Threshold Components 3 In this chapter • Fabric Watch classes, areas, and elements . . . . . . . . . . . . . . . . . . . . . . . . . 19 Fabric Watch classes, areas, and elements Fabric Watch uses a hierarchical organization to track the network device information it monitors. There is a class, area, and element associated with every monitored behavior. Classes are the highest level in the system, subdivided into one or more areas. Areas contain one or more elements.
3 Fabric Watch classes, areas, and elements • Chapter 8, “System Monitoring” The Resource class and Environment class areas and actions are configured using the sysMonitor command. The FRU class actions are configured using the fwFruCfg command Elements Fabric Watch defines an element as any fabric or switch component that the software monitors. Within each area, the number of elements is equivalent to the number of components being monitored.
Fabric Watch classes, areas, and elements TABLE 1 3 Fabric Watch classes (Continued) Class Description Port Enables you to set additional thresholds specific to different types of ports. The Port class is made up of the following sub-classes: • E_Port class—Represents ports connected to another switch. • FOP_Port class — Represents fabric or fabric loop ports that are made of optical fiber. • FCU_Port class — Represents fabric or fabric loop ports that are made of copper.
3 22 Fabric Watch classes, areas, and elements Fabric Watch Administrator’s Guide 53-1002752-01
Chapter Fabric Watch Activation 4 In this chapter • Interfaces for activating Fabric Watch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 Interfaces for activating Fabric Watch This section provides a brief overview of the available user interfaces for activating Fabric Watch. Further details about Fabric Watch operations for each interface are provided later in this guide.
4 Interfaces for activating Fabric Watch If the Fabric Watch license is not listed, continue to step 4; otherwise, you are ready to use Fabric Watch. 4. Enter the license key with the licenseAdd key command, where key is the Fabric Watch license key. License keys are case-sensitive, so type the license key exactly as it appears. switch:admin> licenseadd "R9cQ9RcbddUAdRAX" 5. Enter the licenseShow command to verify successful activation.
Interfaces for activating Fabric Watch 4 In Figure 5, the MIB browser populated the left side of the screen with a MIB tree that you can navigate. 3. Open Web Tools and select Tasks > Manage > Switch Admin. 4. Click Show Advanced Mode. 5. On the SNMP tab, enter the IP address of the trap receiver and the severity level, and click Apply. NOTE The severity level must be informational (4) in order to forward threshold alerts. 6.
4 Interfaces for activating Fabric Watch Trap Recipient's IP address in dot notation: Community (rw): [OrigEquipMfr] Trap Recipient's IP address in dot notation: Community (rw): [private] Trap Recipient's IP address in dot notation: Community (ro): [public] Trap Recipient's IP address in dot notation: Trap recipient Severity level : (0..
Interfaces for activating Fabric Watch 4 10. Expand the tree on the left to find the Fabric Watch OID information. To find the OID, navigate the following hierarchy: SW-MIB. bcsi. commDev; fibrechannel, fcSwitch, sw, swFWSystem. Fabric Watch displays a screen similiar to the one shown in Figure 6. FIGURE 6 Example OID tree 11. Obtain the specific identifier for the element that will be modified.
4 Interfaces for activating Fabric Watch Activating Fabric Watch using Web Tools You can open Web Tools on any workstation with a compatible Web browser installed. 1. Open the Web browser and type the IP address of the device in the Address field: http://10.77.77.77 or https://10.77.77.77 2. Press Enter. A browser window opens to open Web Tools. A Login dialog box opens. 3. Enter your username and password. 4. Select a switch from the Fabric Tree and log in if necessary. 5.
Chapter 5 Fabric Watch Configuration In this chapter • Fabric Watch configuration tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Setting Fabric Watch custom and default values . . . . . . . . . . . . . . . . . . . . . • E-mail notification configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Notification configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
5 Fabric Watch configuration tasks TABLE 2 30 Fabric Watch configuration tasks (Continued) Configuration task Command Location of procedure Set the following parameters for port monitoring: • Port type • Area type • Time base • Threshold level • Trigger (boundary level) • Action (notification type) • Buffer • Port fencing portThConfig portFencing “Port Monitoring” on page 55 Set the port persistence time fwSet --port -persistence “Setting the port persistence time” on page 69 Configure port fe
Setting Fabric Watch custom and default values 5 Setting Fabric Watch custom and default values Use the following commands to switch between custom and default values. These commands reset all thresholds for all classes: • fwSetToCustom - Sets the boundary and alarm level to custom. • fwSetToDefault - Restores the boundary and alarm level to the default. E-mail notification configuration In environments where it is critical that you are notified about errors quickly, you can use e-mail notifications.
5 E-mail notification configuration The Config Show menu lists each class for which you can provide a separate e-mail address. 2. Enter the number corresponding to the class for which the e-mail configuration should be displayed. Fabric Watch displays e-mail alert information such as: Mail Recipient Information ____________________________________ Email Alert = enabled Mail Recipient = sysadmin@mycompany.com The system returns to the main fwMailCfg menu. Disabling an e-mail alert 1.
E-mail notification configuration 5 Sending a test e-mail message 1. Enter 4 in the fwMailCfg menu to test the e-mail configuration for a specific class. The Config Show menu displays. 2. Select a class to test. If the e-mail configuration for the class is complete, the following confirmation message displays: Email has been sent If the e-mail configuration for the class is not complete, the following error message displays: Email has not been sent.
5 Notification configuration The following message displays: Setting 192.168.39.118 as Relay Host.. 4. Enter the Domain Name (example: Brocade.com). Displaying the relay host configuration 1. Enter 6 in the fwMailCfg menu to display the relay host configuration menu. 1 2 3 4 Display Relay Host configuration Set Relay Host IP Remove Relay Host configuration Quit 2. Enter 1 to display the configuration. Removing the relay host configuration 1.
Notification configuration 5 2. Enter the following command if you decide not to have notifications sent. switch:admin> fwAlarmsFilterSet 0 The 0 option turns the alarm notification off. All notifications are suppressed when alarm notifications are turned off, except for the Environment class and Resource class. 3. Verify or view your current alarm notifications by using the fwAlarmsFilterShow command.
5 36 Notification configuration Fabric Watch Administrator’s Guide 53-1002752-01
Chapter 6 Fabric, Security, SFP, and Performance Monitoring In this chapter • Fabric monitoring guidelines and default settings . . . . . . . . . . . . . . . . . . . . • Security monitoring guidelines and default settings. . . . . . . . . . . . . . . . . . . • SFP monitoring guidelines and default settings . . . . . . . . . . . . . . . . . . . . . . • Performance monitoring guidelines and default settings. . . . . . . . . . . . . . . • thConfig command . . . . . . . . . . . . . . . . . . . . . . . . . .
6 Fabric monitoring guidelines and default settings TABLE 3 Fabric class areas (Continued) Area Description Segmentation changes (SC) Tracks the cumulative number of segmentation changes. Segmentation changes occur because of one of the following: • Zone conflicts. • Incompatible link parameters. During E_Port and VE_Port initialization, ports exchange link parameters, and incompatible parameters result in segmentation. This is a rare event. • Domain conflicts.
Fabric monitoring guidelines and default settings 6 Fabric class default settings Table 4 provides default settings for areas in the Fabric class.
6 Security monitoring guidelines and default settings Security monitoring guidelines and default settings The Security class monitors all attempts to breach your SAN security, helping you fine-tune your security measures. Security class areas Table 5 lists Product Name areas in the Security class and describes what each area indicates. Although it is recommended that you leave the entire Security class in its default state (no alerts), you can configure the Security class using the thConfig command.
Security monitoring guidelines and default settings 6 Security monitoring default settings Use the Security class default settings shown in Table 6 for area and notification configuration. There is no reason to alter the default settings.
6 Security monitoring guidelines and default settings TABLE 6 42 Security class area default settings (Continued) Area Description Default threshold settings Default alarm settings Threshold state SLAP failures (FSLAP) Monitors SLAP failures Unit: Violations Time Base: minute Low: 1 High: 2 Buffer: 0 Below: 0 Above: 3 Informative Out_of_range Telnet violations (TV) Monitors Telnet violations Unit: Violations Time Base: minute Low: 1 High: 2 Buffer: 0 Below: 0 Above: 3 Informative Out_of_ra
SFP monitoring guidelines and default settings 6 SFP monitoring guidelines and default settings The SFP class groups areas that monitor the physical aspects of SFPs. An SFP class alarm alerts you to an SFP malfunction fault. SFP performance monitoring is not supported on VE_Ports. When a port goes offline, the RXP and TXP area values of the SFP become zero.
6 SFP monitoring guidelines and default settings SFP monitoring default settings The SFP default settings are shown in Table 8. The default alarm configuration (log all alarms only to the error log) is sufficient. It is recommended that you do not allow alerts to go out as SNMP traps. If other Port class issues are reported, review the error log for any supporting data for SFP issues.
Performance monitoring guidelines and default settings 6 Performance monitoring guidelines and default settings Performance monitoring serves as a tuning tool. The Performance Monitor class groups areas that track the source and destination of traffic. Use the Performance Monitor class thresholds and alarms to determine traffic load and flow and to reallocate resources appropriately. NOTE Performance Monitoring is not supported on VE_Ports.
6 thConfig command Table 11 provides default settings for areas in the End-to-End Performance Monitor class.
thConfig command TABLE 12 6 Configuration options for thConfig command Class name Valid area types Threshold Threshold action Configuration recommendation Fabric ED - Number of E_Ports down FC - Fabric reconfiguration DC - Domain ID changes SC - Segmentation changes ZC - Zone changes FL - Fabric logins Default or Custom1 Default or Custom2 It is recommended that you leave the entire Fabric class in its default state (no alerts).
6 thConfig command thConfig command examples With the exception of setting thresholds for the RX area of an end-to-end (EE) performance monitor, which requires special licensing in Access Gateway mode, it is recommended that you use the default settings for these classes. Setting the high threshold of the RX area of an EE monitor The thConfig command provides the ability to monitor thresholds for frame monitoring and end-to-end (EE) performance on both Access Gateway (AG) switches and non-AG switches.
thConfig command 6 Fabric Watch also monitors the Brocade Quad SFP (QSFP) and, as with the 16 Gbps SFP, if configured thresholds are crossed, Fabric Watch generates an SNMP alarm, a RASlog message, and an e-mail alert for the following SFP areas: • • • • Current Voltage Temperature RXP NOTE On core blades, only the 16 Gbps QSFPs can be installed. Voltage and temperature monitoring using the QSFP A QSFP connects four ports of one core blade of a chassis to another core blade of a different chassis.
6 thConfig command Specifying the 16 Gbps SFP type You can use the sfpType operand to manage the actions and thresholds for the Current, Voltage, RXP, TXP, and Temperature areas of the 16 Gbps SFPs. If you do not provide the SFP type parameters, the existing thresholds and actions of the SFP class are changed to the default. SFP types for the 10 Gbps SFPs and 16 Gbps SFPs and QSFPs are listed in Table 13.
6 thConfig command TABLE 13 SfpType Others 16 Gbps and QSFP configurable SFP types (Continued) Serial number N/A Area Temperature (Centigrade) Default Value 85 -10 Voltage (mVoltage) 3630 2970 RXP (uW) 5000 0 TXP (uW) 5000 0 50 0 Current (mAmp) Displaying the number of 16 Gbps SFP operational hours To show the number of hours that the 16 Gbps SFP is operational, enter the thConfig command using the following parameter. Note that the only supported timebase for this area is none.
6 Recommended settings for Fabric, SFP, Performance, Security classes Recommended settings for Fabric, SFP, Performance, Security classes Table 14 lists the recommended settings for the Fabric, SFP, Security, and Performance classes discussed in this chapter. For all of these classes, it is recommended that you use the default settings.
6 Recommended settings for Fabric, SFP, Performance, Security classes TABLE 14 Recommended settings for Fabric, SFP, Performance, and Security classes (Continued) E=Error_Log, S=SNMP_Trap, P=Port_LOG_LOCK, M=EMAIL_ALERT, F=Port Fence Low Thresh High Thresh Buffer Default Minute 1 2 0 X E,S HTTP violations X Violations Minute 1 2 0 X E,S SCC violations X Violations Minute 1 2 0 X E,S DCC violations X Violations Minute 1 4 0 X E,S Login violations X Violations Minut
6 54 Recommended settings for Fabric, SFP, Performance, Security classes Fabric Watch Administrator’s Guide 53-1002752-01
Chapter 7 Port Monitoring In this chapter • Port class areas . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Port class guidelines and default settings. . . . . . . . . . . . . . . . . . . . . . . . . . . • Port configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • portThConfig command procedures. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Port fencing . . . . . . . . . . . . . . .
7 Port class guidelines and default settings TABLE 15 Port class areas (Continued) Area Description Sync loss The number of times a synchronization error occurs on the port. Two devices failed to communicate at the same speed. Synchronization errors are always accompanied by a link failure. Loss of synchronization errors frequently occur due to a faulty SFP or cable. Packet loss (VE_Port only) The number of packets routed through a port exceeds the port bandwidth.
Port class guidelines and default settings 7 Physical port setting guidelines It is recommended that you use the default settings listed in Table 16 for most Port class areas. Consider the Port class to be a superset containing the E_Port, FOP_Port, and FCU_Port subclasses. If you make a change to a default setting for an area in the Port class, it applies to all of the subclasses.
7 Port configuration TABLE 16 Port class default settings (Continued) Area Description Default threshold settings Default alarm settings Threshold state Protocol errors (PE) Monitors the number of primitive sequence errors. Unit: Errors Time Base: minute Low: 0 High: 5 Buffer: 0 Below: 0 Above: 0 Informative Out_of_range Received packets (RXP) Monitors receive rate, by percentage.
portThConfig command procedures 7 NOTE The execution of this command is subject to Virtual Fabric or Admin Domain restrictions that may be in place. Refer to the Fabric OS Command Reference Manual for more information and for details about the portThConfig command. Using the nosave command The nosave command prevents the configuration changes from being saved persistently. This option allows you to make and view changes without overwriting the saved configuration.
7 portThConfig command procedures • Set the buffer setting to 0 (the default is 100). Note that if you do not specify the buffer value, Fabric Watch automatically re-calculates the buffer. • Apply the new custom settings so they become effective. 2. Apply the new custom settings so they become effective: switch:admin> portthconfig --apply port -area crc -action cust -thresh_level custom 3.
portThConfig command procedures 7 NOTE You cannot specify all for all classes but you can specify all for all areas. switch:admin> portthconfig --pause | --continue -area -port <[slot/]port> E_Port subclass setting guidelines E_Port guidelines for the areas listed below represent a more aggressive approach in most areas, because failing or failed E_Ports in a large fabric can cause serious fabric-wide issues if not detected early.
7 portThConfig command procedures • Area: Class 3 (C3) Discards Unlike the other areas, take a conservative approach for the C3 Discards area. Use the default settings and configure the alarms for Above. The goal is to determine the high boundary at which the port would be fenced, so monitor the high boundary and change the settings accordingly. • Area: Trunk Utilization Set the high boundary to 75 percent and the alarms to Above and In-Between conditions.
portThConfig command procedures TABLE 17 E_Port class default settings (Continued) Area Description Default threshold settings Default alarm settings Threshold state Signal loss Monitors the number of signal loss errors. Unit: Errors Time Base: minute Low: 0 High: 5 Buffer: 0 Below: 0 Above: 0 Informative Out_of_range Sync loss Monitors the number of loss of synchronization errors.
7 portThConfig command procedures TABLE 17 E_Port class default settings (Continued) Area Description Default threshold settings Default alarm settings Threshold state Utilization The percent of utilization for the port at the time of the last poll. Unit: Errors Time Base: minute Low: 0 High: 100 Buffer: 0 Below: 0 Above: 0 Informative Informative Link reset Monitors the number of link resets sent by a given port (LR-Out) and received on a given port (LR-In).
portThConfig command procedures 7 • Areas: Receive (Rx) Performance, Transmit (Tx) Performance Rx and Tx Performance areas are used to monitor the bandwidth utilization of the device ports in the fabric. Set the high boundary to 85 percent and the alarms to Above and In-Between conditions. The same levels should be set on both Host and storage device ports. NOTE With the increased use of virtual environments, alerts from device ports are increasing more than ever in the past.
7 portThConfig command procedures TABLE 18 66 FOP_Port and FCU_Port class default settings Area Description Default threshold settings Default alarm settings Threshold state Cyclic redundancy check (CRC) Monitors the number of CRC errors. Unit: Errors Time Base: minute Low: 0 High: 1000 Buffer: 100 Below: 0 Above: 0 Informative Out_of_range Invalid transmission words (ITW) Monitors the number of invalid words transmitted. For Fabric OS versions 7.1.
portThConfig command procedures TABLE 18 FOP_Port and FCU_Port class default settings (Continued) Area Description Default threshold settings Default alarm settings Threshold state State changes (ST) Monitors state changes. Unit: Changes Time Base: minute Low: 0 High: 50 Buffer: 0 Below: 0 Above: 0 Informative Out_of_range Transmitted packets (TXP) Monitors the transmit rate, by percentage.
7 portThConfig command procedures VE_Port class default settings Table 19 provides default settings (per minute) for areas in the VE_Port class. The VE_Port type is not supported in Access Gateway mode. NOTE Only a subset of areas, shown in Table 19, can be configured for the VE_Port class. When setting VE_Port thresholds for the Packet Loss area, the threshold value accepts up to two decimal points; for example: -value 0.60, as shown in “Packet loss monitoring enhancements on the VE_Port”.
Port fencing 7 Setting the port persistence time Port persistence is used to transition a port into a marginal status. Fabric Watch does not record the event until the event persists for a length of time equal to the port persistence time. If the port returns to normal boundaries before the port persistence time elapses, Fabric Watch does not record the event. The port persistent time is measured in seconds and can be configured. Configuring the port persistence time to zero disables this feature.
7 Port fencing NOTE The execution of the portFencing command is subject to Virtual Fabric (VF) or Admin Domain restrictions that may be in place. For example, in non-VF chassis environments, the state change counter of a trunked slave port gets incremented by more than 1 when the master EX_Port changes its state. Therefore, it is advisable to set the port fencing high threshold for the State Change area to a value greater than 4 in this environment.
Port fencing TABLE 21 7 Recommended port fencing thresholds Area Moderate/recommended threshold Aggressive threshold Conservative threshold Cyclic redundancy check (CRC) Low 5 High 20 Low 0 High 2 Low 5 High 40 Invalid transmission word (ITW) Low 25 High 40 Low 0 High 25 Low 25 High 80 Link reset (LR) Low 0 High 5 Defaults Defaults State change (ST) Low 0 High 7 Defaults Defaults Class 3 frame discard due to timeout (C3TX_TO) Low 0 High 5 N/A N/A Enabling port fencing 1.
7 Recommended port configuration settings Port fencing requirements To configure port fencing using the DCFM management application, all Fabric OS devices must have Fabric Watch and must be running firmware Fabric OS 6.2 or later. Port fencing threshold areas supported on BNA You can add, edit, view, or remove thresholds on the following area types using Brocade Network Advisor (BNA). You can then assign the thresholds to available objects in the BNA tree.
7 Recommended port configuration settings TABLE 22 Recommended configuration for the Port class E=Error_Log, S=SNMP_Trap, P=Port_LOG_LOCK, M=EMAIL_ALERT, pf=Port Fence Low Thresh High Thresh Buffer Default Minute 0 500 50 X Sync Loss X Errors Minute 0 500 50 X Signal Loss X Errors Minute 0 5 0 X Protocol Error X Errors Minute 0 5 0 X Invalid Words X Errors Minute 0 25 0 X E Invalid CRCs X Errors Minute 0 5 0 X E X Percentage Minute 0 100 0 X TX P
7 Recommended port configuration settings TABLE 22 Recommended configuration for the Port class (Continued) E=Error_Log, S=SNMP_Trap, P=Port_LOG_LOCK, M=EMAIL_ALERT, pf=Port Fence High Thresh Buffer 0 15 0 X E,S Sync Loss X Errors Minute 0 45 0 X E,S HOST Signal Loss X Errors Minute 0 45 0 X E,S Protocol Error X Errors Minute 0 5 0 X Invalid Words X Errors Minute 0 1000 100 X E,S,F pf Invalid CRCs X Errors Minute 0 1000 100 X E,S,F pf RX Performance
Chapter 8 System Monitoring In this chapter • Environment monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Resource class settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • System monitoring using the sysMonitor command . . . . . . . . . . . . . . . . . . . • Recommended environment and resource monitoring settings . . . . . . . . . • Switch monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
8 Environment monitoring Environment monitoring setting guidelines Use Environment Class default settings. Temperature settings are switch-dependent and there is no need to alter them. The default alarm configuration, sending alerts to the error log and SNMP, is sufficient. Environment class default settings Table 24 provides default Environment class settings for all switches. Check the appropriate hardware reference manual for differences in actual environmental requirements.
Resource class settings TABLE 24 8 Environment class default settings (Continued) Area Description Default threshold settings Default alarm settings Threshold state Below: 3 Above: 3 Informative Out-of-range Brocade 8000 Low: 0 High: 73 Buffer: 10 Brocade DCX Low: 0 High: 70 Buffer: 10 Brocade DCX-4S Low: 0 High: 75 Buffer: 10 Resource class settings The Resource class monitors flash memory. It calculates the amount of flash space consumed and compares it to a defined threshold.
8 System monitoring using the sysMonitor command System monitoring using the sysMonitor command Use the sysMonitor command to configure temperature and system resource settings at the chassis level. For detailed information about the sysMonitor command, refer to the Fabric OS Command Reference Manual. The following operations are supported by the sysMonitor command: • Configure thresholds for Fabric Watch event monitoring and reporting for the environment and resource classes.
Examples of the sysMonitor command 8 Examples of the sysMonitor command The following sections provide specific examples for the Environment class, CPU, and memory. Environment class settings Temperature settings are switch-dependent and there is no need to alter them. The default alarm configuration, sending alerts to the error log and SNMP, is sufficient. See “Environment monitoring setting guidelines” on page 76 for more information.
8 Examples of the sysMonitor command CPU and memory When configuring CPU monitoring, specify a value in the 1-100 range. When the CPU usage exceeds the limit, a Fabric Watch alert is triggered. The default CPU limit is 75 percent. When configuring memory, the limit specifies a usage limit as a percentage of available resources. When used to configure memory monitoring the limit value must be greater than the low limit and smaller than the high limit.
8 Recommended environment and resource monitoring settings Configuring the system memory usage monitoring threshold Enter the sysMonitor command using the following parameters: switch:admin> sysmonitor --config mem -poll 10 -retry 1 -limit 20 -action snmp, raslog -high_limit 80 Recommended environment and resource monitoring settings Table 27 lists the recommended settings for Environment and Resource classes.
8 Switch monitoring Switch status policy planning Fabric Watch monitors the health of the switch under various classes. Table 28 lists the current overall switch status policy parameters in a switch and identifies the factors that affect their health. Note that not all switches use the listed monitors. Use the switchstatusPolicySet command to manually change the policy setting. Refer to the FOS Command Reference Manual for more information.
Switch monitoring 8 TABLE 28 Switch status policy factors Monitor Health factors Marginal Ports1 Port, E_Port, FOP_port (optical), and FCU_Port (copper) port thresholds. Whenever these thresholds are persistently high, the port is Marginal. Faulty Ports1 Hardware-related port faults. Missing SFPs Error Ports1 1 Ports that are missing SFP media. Ports with errors.
8 FRU monitoring • Missing SFPs—Monitors the number of ports without SFPs. • Error Ports—Ports that are disabled because of segmentation, an authentication failure, port fencing, or bottleneck detection. The policy you defined determines the output in the Switch Status Policy Report. See Chapter 10, “Fabric Watch Reports,” for more details about the Switch Status Policy Report. FRU monitoring Supported FRU areas depend on the type of Brocade switch.
FRU monitoring 8 4. In the prompt that follows your current FRU configuration, you are asked to provide values for each FRU alarm state and alarm action. To accept the default value for each FRU, press Return. After you have configured a FRU alarm state and alarm action, the values apply to all FRUs of that type. For example, the values specified for a slot FRU will apply to all slots in the enclosure.
8 FRU monitoring Recommended FRU settings Table 30 lists the recommended settings for field-replaceable units (FRUs).
Chapter Fabric Watch Configuration Using Web Tools 9 In this chapter • Fabric Watch Configuration Using Web Tools . . . . . . . . . . . . . . . . . . . . . . . . 87 Fabric Watch Configuration Using Web Tools You can use Web Tools to define the following Fabric Watch configurations: • Configure custom threshold values on particular elements. • Place limits on the acceptable values of those elements and enable the custom limits (configure threshold boundaries).
9 Fabric Watch Configuration Using Web Tools NOTE Unless the switch is a member of the current Admin Domain context, Fabric Watch is view-only. FIGURE 7 Fabric Watch dialog box Fabric Watch Explorer, on the left side of the window, displays the available classes. Not all classes are available for all switches. The status bar at the bottom of the window provides you with a summary of recent actions, and the date and time the module was last updated.
Fabric Watch Configuration Using Web Tools 9 4. Click the Alarm Configuration tab. 5. Select SNMP Trap, RAS log, or both options. 6. Click Apply. Fabric Watch threshold configuration using Web Tools The Threshold Configuration tab enables you to configure event conditions. From this tab, you configure threshold traits, alarms, and e-mail configurations. NOTE Use the procedures in this section to configure threshold traits for all classes except for the FRU class.
9 Fabric Watch Configuration Using Web Tools 9. Enter the highest boundary of the normal zone in the High Boundary field. 10. Enter the size of the buffer zone in the Buffer Size field. 11. Click Apply. Configuring threshold alarms After you update the threshold information, use the Alarm Configuration subtab to customize the notification settings for each event setting.
Fabric Watch Configuration Using Web Tools 9 • Click Custom Defined to specify new settings and proceed to the next step. 6. Select the check box for the type of notification method you want to use for each event type. The available alarm actions are: • • • • 7. ERROR_LOG SNMP_TRAP PORT_LOG_LOCK EMAIL_ALERT Click Apply. Enabling or disabling threshold alarms for individual elements To configure element-specific alarm settings, perform the following steps. 1. Open the Fabric Watch window. 2.
9 Fabric Watch Configuration Using Web Tools Configuring alarms for FRUs using Web Tools Configuration for the FRU class is different from configuration for the other classes. Because FRUs are not monitored through a threshold-based system, they have a simpler interface for configuration. For FRUs, you configure the states for which an event occurs, as described in the following procedure. 1. Open the Fabric Watch window. 2. Select the Threshold Configuration tab. 3.
Fabric Watch Configuration Using Web Tools 9 Fabric Watch alarm information From Fabric Watch, you can view two types of reports: • Alarm notifications—Displays the alarms that occurred for a selected class or area. • Alarm configuration—Displays threshold and alarm configurations for a selected class or area.
9 Fabric Watch Configuration Using Web Tools To display the alarms page, perform the following steps. 1. Open the Fabric Watch window. 2. In Fabric Watch Explorer, select the class that you want to check for alarms. 3. Select the Alarm Notification tab. 4. In Area Selection, select the area that you want to check for alarms from the list. All alarms for that area display. E-mail notification using Web Tools You can be notified of an alarm condition through an e-mail alert.
Fabric Watch Configuration Using Web Tools 9 To enable an e-mail alerts recipient, perform the following steps. 1. Open the Fabric Watch window. 2. Select the Email Configuration tab. 3. Select a FRU class in the Fabric Watch Explorer tree. 4. Click Enable. 5. Enter the e-mail address of the recipients in the Recipient Email Address field. Separate the e-mail addresses with commas. 6. Click Apply. 7. Repeat steps 3 through 6 for any additional FRU classes. 8.
9 96 Fabric Watch Configuration Using Web Tools Fabric Watch Administrator’s Guide 53-1002752-01
Chapter 10 Fabric Watch Reports In this chapter • Fabric Watch reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97 • Switch Availability Monitor report . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98 • Switch Health report . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99 • Switch Status Policy report . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
10 Switch Availability Monitor report Switch Availability Monitor report The Switch Availability Monitor (SAM) report lets you see the uptime and downtime for each port. It also enables you to check if a particular port is failing more often than the others. NOTE SAM report details do not display the health status of GbE ports. Fabric Watch only monitors and reports the status for physical and virtual FC ports. You can run reporting commands in Fabric Watch to get instant access to switch information.
Switch Health report 2/12 2/13 2/14 2/15 3/0 3/1 3/2 3/3 3/4 3/5 3/6 3/7 3/8 3/9 3/10 LB LB U LB T U U U U U U U U U VE 100 100 0 100 100 0 0 0 0 0 0 0 0 0 100 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 100 0 0 100 100 100 100 100 100 100 100 100 0 Switch Health report The Switch Health report lists the following information: • Current health of each port, based on the currently-configured policy settings.
10 Switch Status Policy report The final portion of the report, detailing port health, is not available without a Fabric Watch license. Switch Status Policy report The Switch Status Policy report displays the current policy parameter. The following example of the switchStatusPolicyShow command output is for enterprise-class platforms such as the DCX Backbone. For modular switches, the switch status policy report also contains information on the WWN, Blade, and CP.
10 Port Detail report Port Detail report If the Switch Health report shows marginal throughput or decreased performance, use the Port Detail report to see statistics on each port. The Port Detail report is a Fabric Watch licensed product. You can also see port details by health. For example, you can see only healthy ports, only marginal ports, only faulty ports, or only offline ports. The following is an example of a Port Detail report.
10 Port Detail report 219 220 221 222 223 VE VE VE VE VE HEALTHY HEALTHY HEALTHY HEALTHY HEALTHY 003:37 002:48 061:19 061:19 061:19 - - - - - - - - - - - - - NOTE Output of the Port Detail report depends on the ports that belong to the current Admin Domain context. If a port does not belong to the current Admin Domain, nothing other than the port number is displayed for that port.
Index A C above event triggers, 15 access gateway mode, restrictions in Fabric Watch, 12 action configuration guidelines, 4 activating Fabric Watch, 23, 87 using a Telnet session, 23 using SNMP, 24 using Web Tools, 28 alarm behavior, 17 alarm configuration report for Fabric Watch, 93 alarm notification configuration, 34 alarms, Fabric Watch configuring, 90, 92 displaying, 93 enabling and disabling, 91 alerts configuration recommendations, 3 area environment class, 75 fabric class, 37 FRU class, 84 perfor
D data values, 11 default settings E_Port, 62 environment class, 76 Fabric class, 39 FOP_Port and FCU_Port, 65 performance monitor class default settings, 45 port class, 57 VE_Port, 68 disabling Fabric Watch threshold alarms, 91 displaying alarms, Fabric Watch, 93 E E_Port default settings, 62 E_Port setting guidelines, 61 e-mail alert, 9 how to disable, 32 how to enable, 32 setting recipient e-mail address, 33 e-mail notification configuration, 31 email notifications, 94 e-mail, testing a message, 33 enab
FRU class areas, 84 configuration, 84 recommended settings, 86 specifying triggers for alarms, 85 FRU configuration, 30 FRU monitoring, 84 I interface types, 23 invalid CRC area, configuring, 59 IP address, setting for notification, 33 L licenseAdd key command, 24 locked port log notification type, 11 M management information base (MIB), 9 memory configuration limits, 80 configuring the usage threshold, 81 MIBs, using remotely, 8 monitoring customizing settings, 4 fabric events, 5 fabric setting guidelin
relay host configuration displaying, 34 removing, 34 setting, 33 resource class area, 77 default settings, 77 recommended settings, 81 setting guidelines, 77 resource class area, 77 S security class areas, 40 security monitoring, 6 recommended settings, 52 setting time base, 16 settings, customizing, 3 SFP support for 10 Gbps and 16 Gbps, 6 SFP class monitoring guidelines, 43 SFP monitoring, 6 recommended settings, 52 SNMP components of, 8 using to activate Fabric Watch, 24 switch monitoring components, 5
