53-1001342-01 28 July 2009 Fabric Watch Administrator’s Guide Supporting Fabric OS v6.3.
Copyright © 2000-2009 Brocade Communications Systems, Inc. All Rights Reserved. Brocade, the B-wing symbol, BigIron, DCX, Fabric OS, FastIron, IronPoint, IronShield, IronView, IronWare, JetCore, NetIron, SecureIron, ServerIron, StorageX, and TurboIron are registered trademarks, and DCFM, Extraordinary Networks, and SAN Health are trademarks of Brocade Communications Systems, Inc., in the United States and/or in other countries.
Document History Title Publication Number Summary of Changes Date Fabric Watch User’s Guide 53-0001559-02 New document May 2000 Fabric Watch User’s Guide 53-0000198-02 n/a January 2002 Fabric Watch User’s Guide 53-0000186-02 n/a March 2002 Fabric Watch User’s Guide 53-0000504-02 n/a April 2003 Fabric Watch User’s Guide 53-0000524-02 n/a April 2003 Fabric Watch User’s Guide 53-0000524-03 Updated default values and restructured the document.
Title Publication Number Summary of Changes Date Fabric Watch Administrator’s Guide 53-1000601-01 Updates to support Fabric OS v6.0.0 September 2007 Fabric Watch Administrator’s Guide 53-1000601-02 Updates to support Fabric OS v6.1.0 March 2008 Fabric Watch Administrator’s Guide 53-1000601-03 Reorganized many sections to improve clarity. Updates to support Fabric OS v6.2.0: Virtual Fabric, port movement, fan monitoring behavior, link reset, DCX-4S.
Contents About This Document In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .xvii How this document is organized . . . . . . . . . . . . . . . . . . . . . . . . . . . .xvii Supported hardware and software . . . . . . . . . . . . . . . . . . . . . . . . . xviii What’s new in this document . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xix New information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Chapter 2 Fabric Watch Best Practices In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 Fabric Watch default settings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 Reasons to customize Fabric Watch settings . . . . . . . . . . . . . . . . . . . 7 Configuration decisions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Threshold event settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 Above event trigger . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 Below event trigger . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 Changed event trigger . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 In-between event triggers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 Fabric Watch alarm behavior . . . . . . . . . . .
Fabric Watch notification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50 Error log entry (switch event) . . . . . . . . . . . . . . . . . . . . . . . . . . . 50 SNMP notification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50 API notification configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 RAPI trap. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 Port log lock . . . . . . . . . . . . . . . .
Switch status policy planning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 Implementing your switch status policy . . . . . . . . . . . . . . . . . . . 78 Viewing your switch status policy . . . . . . . . . . . . . . . . . . . . . . . . 78 FRU configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79 Chapter 11 System monitoring In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Port Type: Port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .104 Area Type: CRC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .104 Area Type: ITW . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .104 Area Type: C3TX_TO . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .104 Area Type: LinkReset . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .104 Area Type: Protocol Error . . . . . . . .
Appendix D Port fencing types Index Fabric Watch Administrator’s Guide 53-1001342-01 xi
xii Fabric Watch Administrator’s Guide 53-1001342-01
Figures Figure 1 Threshold monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 Figure 2 A buffered data region . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 Figure 3 Time base set to none . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 Figure 4 Event trigger . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
xiv Fabric Watch Administrator’s Guide 53-1001342-01
Tables Table 1 Product Name classes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 Table 2 Environment class areas . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 Table 3 Fabric class areas. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 Table 4 FRU class areas . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
xvi Fabric Watch Administrator’s Guide 53-1001342-01
About This Document In this chapter • How this document is organized . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xvii • Supported hardware and software. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xviii • What’s new in this document . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xix • Document conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xx • Additional information . . . . . . . . . . . . .
• Chapter 11, “System monitoring” describes how to configure system memory and CPU values using the sysMonitor command. • Appendix A, “Fabric Watch commands” lists Fabric Watch commands. Many of these commands are used in advanced configuration tasks. • Appendix B, “Fabric Watch default settings” lists the default settings for all the classes which you can use to rapidly deploy and monitor your fabric.
What’s new in this document This document contains information that was available at the time the product was released. Any information that becomes available after the release of this document is captured in the Release Notes. New information The following Information was added: • Port threshold configuration using the portThConfig command. This does not replace the fwConfigure command but, rather, is an alternate method of configuring port thresholds.
Document conventions This section describes text formatting conventions and important notices formats.
Key terms For definitions specific to Brocade and Fibre Channel, see the Brocade Glossary. For definitions of SAN-specific terms, visit the Storage Networking Industry Association online dictionary at http://www.snia.org/education/dictionary. Additional information This section lists additional Brocade and industry-specific documentation that you might find helpful. Brocade resources To get up-to-the-minute information, go to http://my.brocade.com and register at no cost for a user ID and password.
Getting technical help Contact your switch support supplier for hardware, firmware, and software support, including product repairs and part ordering. To expedite your call, have the following information available: 1.
Document feedback Quality is our first concern at Brocade and we have made every effort to ensure the accuracy and completeness of this document. However, if you find an error or an omission, or you think that a topic needs further development, we want to hear from you. Forward your feedback to: documentation@brocade.com Provide the title and version number of the document and as much detail as possible about your comment, including the topic heading and page number and your suggestions for improvement.
xxiv Fabric Watch Administrator’s Guide 53-1001342-01
Chapter 1 About Fabric Watch In this chapter • Fabric health concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Fabric Watch overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Fabric Watch alarm notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Fabric Watch event notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Fabric Watch audit messages. .
1 Fabric Watch overview Fabric Watch overview Fabric Watch is an optional storage area network (SAN) health monitor that allows you to enable each switch to constantly monitor its SAN fabric for potential faults and automatically alerts you to problems long before they become costly failures. Fabric Watch tracks a variety of SAN fabric elements, events, and counters.
Fabric Watch alarm notifications 1 Fabric Watch alarm notifications Fabric Watch provides the following types of automatic notifications: • A continuous alarm provides a warning message whenever a threshold is breached; it continues to send alerts until the condition is corrected. For example, if a switch exceeds its temperature threshold, Fabric Watch activates an alarm at every measurement interval until the temperature returns to an acceptable level.
1 Fabric Watch audit messages Fabric Watch audit messages Fabric Watch events caused by configuration value changes are tagged as Audit messages. NOTE Audit messages are generated for port fencing configuration changes, whether port fencing is enabled or disabled. You can set up an external host to receive Audit messages so you can easily monitor unexpected changes. For information on error messages generated by Fabric Watch, see the Fabric OS Message Reference.
Switch policies 1 Switch policies Switch policies are a series of rules that define specific health states for the overall switch. Fabric OS interacts with Fabric Watch using these policies. Each rule defines the number of types of errors that transitions the overall switch state into a state that is not healthy. For example, you can specify a switch policy so that if a switch has two port failures, it is considered to be in a marginal state; if it has four failures, it is in a down state.
1 Port fencing Port fencing A port that is consistently unstable can harm the responsiveness and stability of the entire fabric and diminish the ability of the management platform to control and monitor the switches within the fabric. Port Fencing is a Fabric Watch enhancement that takes the Port class, E_Port class, and F/FL_Port class ports offline if the user-defined thresholds are exceeded. NOTE Port Fencing is not enabled by default. You must manually enable Port Fencing.
Chapter Fabric Watch Best Practices 2 In this chapter • Fabric Watch default settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 • Reasons to customize Fabric Watch settings . . . . . . . . . . . . . . . . . . . . . . . . . 7 • Configuration decisions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 Fabric Watch default settings A default Fabric Watch configuration is available for the purpose of saving setup time.
Configuration decisions Configuration decisions Before you begin an implementation, make some decisions surrounding the following major configuration tasks. Monitoring Do you want to monitor all class areas, or implement the monitoring in incremental stages? If you monitor class areas incrementally, you should configure Fabric Watch to monitor the classes in the following order: • Step 1.
Configuration decisions Thresholds Before you begin to configure thresholds, decide if you want to have different levels of alerts for E_ports and F/FL_Ports and configure the ports individually. Always set up thresholds one fabric at a time and test the configuration before you apply the threshold configuration to more switches or fabrics.
Configuration decisions Notification methods Fabric Watch alerts can be sent using one of the following notification methods, which are described in detail in “Fabric Watch event notifications” on page 3. We recommend using either SNMP trap alerting to your system management console or event log entry in conjunction with Syslog forwarding configured on your switches.
Chapter 3 Fabric Watch components In this chapter • Fabric Watch classes, areas, and elements . . . . . . . . . . . . . . . . . . . . . . . . . • Classes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Areas. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Elements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
3 Classes Table 1 describes the classes into which Fabric Watch groups all switch and fabric elements. TABLE 1 12 Fabric Watch classes Class Description Environment Includes information about the physical environment in which the switch resides and the internal environment of the switch. For example, an Environment-class alarm alerts you to problems or potential problems with temperature and power.
Areas 3 Areas While classes represent large groupings of information, areas represent the information that Fabric Watch monitors. For example, switch temperature, one of the values tracked by Fabric Watch, is an area within the class Environment. The tables in this section describe all of the areas monitored by Fabric Watch, organized by their associated classes. Environment class areas Table 2 lists and describes the Fabric Watch areas in the Environment class.
3 Areas TABLE 3 Fabric class areas (Continued) Area Description Segmentation changes Tracks the cumulative number of segmentation changes. Segmentation changes occur because of one of the following: • Zone conflicts. • Incompatible link parameters. During E_Port and VE_Port initialization, ports exchange link parameters, and incompatible parameters result in segmentation. This is a rare event. • Domain conflicts. • Segmentation of the principal link between two switches.
Areas 3 Performance Monitor class areas Table 5 lists Fabric Watch areas in the Performance Monitor class and describes each area. TABLE 5 Performance Monitor class areas Area Indicates Customer Defined (Filter Performance Monitor) Values for customer-defined performance areas. For more information on this area, see the Fabric OS Command Reference. Invalid Cyclic Redundancy Checks (CRC) (AL_PA and EE Performance Monitor) Errors have been detected in the Fibre Channel frame.
3 Areas TABLE 6 Port class areas (Continued) Area Indicates Protocol error The number of times a protocol error occurs on a port. Invalid state due to LRR on an online link. Occasionally these errors occur due to software gliches. Persistent errors occur due to hardware problems. Receive (RX) Performance The percentage of maximum bandwidth consumed in packet receipts. State Changes Note: State changes are supported on LISL ports.
Areas 3 Security class areas Table 8 lists Fabric Watch areas in the security class and describes what each area indicates. TABLE 8 Security class areas Area Indicates API Violations An API access request reaches a secure switch from an unauthorized IP address. DCC Violations An unauthorized device attempts to log in to a secure fabric. Front Panel Violations A secure switch detects unauthorized front panel access.
3 Elements SFP class areas Table 9 lists Fabric Watch areas in the SFP class and describes each area. NOTE SFPs connected to GbE ports are not monitored. TABLE 9 SFP class areas Area Description Temperature Measures the physical temperature of the SFP, in degrees Celsius. A high temperature indicates that the SFP might be in danger of damage. Receive Power (RXP) Measures the amount of incoming laser, in µwatts, to help determine if the SFP is in good working condition.
Chapter Fabric Watch threshold concepts 4 In this chapter • Threshold values . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 • Time bases. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 • Threshold event settings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
4 Threshold values FIGURE 1 Threshold monitoring Figure 2 shows how to limit the number of event notifications using a buffer. When you specify a buffer, events cannot occur below the high threshold and above the low threshold. Event notification occurs only where the arrows indicate. The event criteria are continued to be met until the data sensed falls below the low threshold value or above the high threshold value.
Time bases 4 Time bases Time bases are time periods within Fabric Watch. This configurable field affects the comparison of sensor-based data with user-defined threshold values. Time base set to none If you set a time base to none, Fabric Watch compares a data value against a threshold boundary level. When the absolute value of the measuring counter exceeds the threshold boundary, an event is triggered. Figure 3 shows a high limit of 65 degrees Celsius placed on a counter measuring temperature.
4 Time bases Example 1: Triggering an event Figure 4 shows a sample graph of data obtained by Fabric Watch (the type of data is irrelevant to the example). A high threshold of 2 is specified to trigger an event. A time base of minute is defined. An event occurs only if the rate of change in the specific interval (one minute in this example) is across the threshold boundary. It should be either higher than the high threshold limit or lower than the low threshold limit.
Threshold event settings FIGURE 5 4 Example without an event Threshold event settings This section describes how Fabric Watch compares a fabric element’s data value against a threshold value to determine whether or not to trigger an event. It describes how a specified buffer zone affects event triggering. For Fabric Watch to monitor data values for one of the following conditions, the alarm setting must be set to a nonzero value.
4 Threshold event settings FIGURE 6 Above event trigger with buffer zone Below event trigger The Below event trigger generates an event when a data value becomes less than the low threshold boundary. When a buffer is defined, the event will be triggered only when the value goes below the lower threshold. A second event will not be generated until the value crosses the buffer region set above the lower threshold.
Threshold event settings 4 In-between event triggers Fabric Watch event triggers are usually set to notify the user of a warning or failure condition, but there is an exception. You can define the In-Between event trigger to receive a notification of fault recovery. For example, when measuring port performance, crossing the high threshold triggers an Above threshold event, which displays a warning message. The threshold might be crossed for a period so brief that is not a true cause for an alarm.
4 26 Threshold event settings Fabric Watch Administrator’s Guide 53-1001342-01
Chapter Fabric Watch activation 5 In this chapter • Interfaces for activating Fabric Watch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 Interfaces for activating Fabric Watch This section provides a brief overview of the available user interfaces for activating Fabric Watch. Further details about Fabric Watch operations for each interface are provided later in this guide.
5 Interfaces for activating Fabric Watch If the Fabric Watch license is not listed, continue to step 4; otherwise, you are ready to use Fabric Watch. 4. Enter the license key with the licenseAdd key command, where key is the Fabric Watch license key. License keys are case-sensitive, so type the license key exactly as it appears. switch:admin> licenseadd "R9cQ9RcbddUAdRAX" 5. Enter the licenseShow command to verify successful activation.
Interfaces for activating Fabric Watch 5 Activating Fabric Watch using SNMP You can integrate Fabric Watch with existing enterprise systems management tools, such as SNMP. The Fabric Watch Management Information Base (MIB) lets system administrators configure fabric elements, receive SNMP traps generated by fabric events, and obtain the status of fabric elements through SNMP-based enterprise managers. NOTE The following instructions apply to the AdvantNet MIB browser.
5 Interfaces for activating Fabric Watch 6. Start a Telnet session, and enter the snmpConfig -set mibcapability command at the prompt to set the SNMP MIB capability. NOTE Currently, setting the SNMP MIB capability can only be done from the CLI.
Interfaces for activating Fabric Watch 5 Trap Recipient's IP address in dot notation: [0.0.0.0] Community (ro): [FibreChannel] Trap Recipient's IP address in dot notation: [0.0.0.
5 Interfaces for activating Fabric Watch 10. Expand the tree on the left to find the Fabric Watch OID information. To find the OID, navigate the following hierarchy: SW-MIB. bcsi. commDev; fibrechannel, fcSwitch, sw, swFWSystem. Fabric Watch displays a screen similiar to the one shown in Figure 10. FIGURE 10 Example OID tree 11. Obtain the specific identifier for the element that will be modified.
Chapter 6 Fabric Watch basic configurations In this chapter • Fabric Watch configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Threshold configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Event configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Fabric Watch notification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
6 Fabric Watch configuration Configuration files When you activate Fabric Watch, it uses the default settings described in “Fabric Watch Best Practices” on page 7. You cannot alter these default settings; if the default values do not suit your specific needs, configure Fabric Watch to use more appropriate settings. When you configure the new settings for Fabric Watch, your switch stores the settings in the configuration file.
Threshold configuration 6 Setting the port persistence time Port persistence is used to transition a port into a marginal status. Fabric Watch does not record the event until the event persists for a length of time equal to the port persistence time. If the port returns to normal boundaries before the port persistence time elapses, Fabric Watch does not record any event. The port persistent time is measured in seconds and can be configured.
6 Threshold configuration 3. Type the number from the list that corresponds to the class that you want to configure. For example, if you type 5, the menu corresponding to the E_Port class displays.
Threshold configuration 6 5. Fabric Watch displays a list of monitored elements in this area. The following sample output shows the monitored elements in the RXPerformance area menu.
6 Threshold configuration Port threshold configuration using the portThConfig command Instead of using the the fwConfigure command to manage the port thresholds, you can use the portThConfig command to configure high and low thresholds , buffers, triggers, and actions on specified ports. NOTE If you want a basic configuration, accept the default configuration settings, which are listed in “Fabric Watch default settings.
Threshold configuration 6 portThConfig --set [ve_port_type][area ] [-timebase ] [-highthreshold -value -trigger above | below -action [raslog],[snmp],[email],[portlog]|none] [-lowthreshold -value -trigger above | below -action [raslog],[snmp],[email],[portlog]|none] [-buffer ] [-nosave] portThConfig --apply -area [-action_level ] [-thresh_level ] where: --help Prints the command usage.
6 Threshold configuration PE - Protocol error LR - Link reset ST - State change TU - Trunk utilization -current_status Displays the selected port’s current threshold status. -thresh_level Displays the threshold level (either default or custom). -action_level Displays the alarms level (either default or custom). --show Displays the threshold configuration for all configured VE_Ports. ve-port Displays the port type to be configured as a VE_Port.
Threshold configuration 6 TU - Trunk utilization -timebase Configures the threshold value to be measured in one of the following time increments: day, hour, minute, or second. -highth Configures the high threshold on the specified port and area type. Refer to Appendix B, “Default Settings” for the default settings for high and low thresholds and buffers for each class and area. Refer to Appendix C, “portThConfig examples” for port threshold configuration examples for each class and area.
6 Threshold configuration fop-port - Configures thresholds for all F_Ports. Port - Configures thresholds for physical ports. --area Configures the area to be configured on a VE_Port. Configurable areas for ports of VE_Port type include the following: util - Port utilization pktLoss - Packet loss ST - State change 42 -timebase Configures the threshold value to be measured in one of the following time increments: day, hour, minute, or second.
Threshold configuration 6 Refreshing a threshold configuration The area menu displays the following five options, which are described in the following sections: 1 2 3 4 5 : : : : : refresh disable a threshold enable a threshold advanced configuration return to previous page Type 1 at the Select choice => prompt. The screen refreshes with the most recently updated monitoring information. After the screen refreshes, the same four options appear.
6 Threshold configuration Enabling a threshold 1. Type 3 at the Select choice => prompt. The system generates output similar to that in the system output below, but the output you see varies based on the class and area you selected. 2. Type the index number of the element for which Fabric Watch should enable monitoring. Fabric Watch redraws the element table with the selected element enabled. A second row of information about the selected element appears, and the status of the element is set to enabled.
Threshold configuration 6 Enabling and disabling all port thresholds Sometimes, you might want to disable all port thresholds at once. For example, during an event such as an upgrade of a device or server, you might elect not to receive error messages for particular ports. When the upgrade is complete, you can show and enable disabled port thresholds. 1. Use the following command to disable the port threshold. switch:admin> fwConfigure --disable --port 9 2.
6 Threshold configuration Threshold boundary level is setat : Default DefaultCustom Unit Percentage(%) Time base minuteminute Low 0 0 High 100 100 BufSize 0 0 Percentage(%) Threshold alarmlevel is set at: Default Errlog-1, SnmpTrap-2, PortLogLock-4 RapiTrap-8, EmailAlert-16, PortFencing-32 Valid alarm matrix is 63 DefaultCustom Changed 0 Below 0 Above 0 InBetween 0 0 0 0 0 1 : change behavior type 11 : 2 : change behavior interval 12 : 3 : change threshold boundary level 13 4 : change custom unit 14 :
Threshold configuration 6 Fabric Watch displays the units of measurement (Unit), time base (Time base), low threshold (Low), high threshold (High) and buffer size (BufSize) for each column. In the following system output, a value of 80% is chosen as the custom high value for RXPerformance. The default value is 100%.
6 Threshold configuration Index 216 217 218 219 220 221 222 223 ThresholdName eportRXPerf216 eportRXPerf217 eportRXPerf218 eportRXPerf219 eportRXPerf220 eportRXPerf221 eportRXPerf222 eportRXPerf223 BehaviorType Triggered 1 Triggered 1 Triggered 1 Triggered 1 Triggered 1 Triggered 1 Triggered 1 Triggered 1 BehaviorInt Threshold boundary level is set at : Custom. 4. Type 9 at the Select choice => prompt to apply the custom value.
Event configuration 6 Event configuration You can customize the information reported by Fabric Watch by configuring event behavior types, threshold values, time bases, and event settings. You cannot change data values; these represent switch behavior that is updated by the software. The following area attributes are used to define and detect events in Fabric Watch.
6 Fabric Watch notification Fabric Watch notification Fabric Watch provides the following notification methods, but not all notification methods can be applied to all of the classes. Valid notification methods are represented through the valid alarm matrix, which is described in “Notification value configuration” on page 53. Error log entry (switch event) The switch event (error) log holds up to 1024 entries. This error log stores event information but does not actively send alerts.
Fabric Watch notification 6 API notification configuration In the Brocade Fabric OS API, notifications are triggered programatically. The Brocade Fabric OS API is an application programming interface (API) that provides the method for any application to access critical information about a Brocade SAN. Using Fabric OS API, an application can query or control individual switches or the entire fabric. You can also configure API notifications using the Brocade Fabric OS API.
6 Fabric Watch notification Alarm notification configuration Alarms act as a signal or alert that notifies you when a threshold has been crossed. NOTE The allowed alarm types are displayed on a per-class basis. Although Port Fencing is displayed for other areas, such as RX Performance for which Port Fencing is not supported, you will not be able to set or apply changes on such areas.
Fabric Watch notification 6 Notification value configuration You can specify a particular notification method that you want Fabric Watch to use by assigning it a value. The value is the sum of the alarm matrix values; for example, PortFencing-32, SnmpTrap-2, and Errlog-1 (32+2+1=35). Table 10 shows the numerical values for each notification method.
6 Fabric Watch notification Index 216 217 218 219 220 221 222 223 ThresholdName eportRXPerf216 eportRXPerf217 eportRXPerf218 eportRXPerf219 eportRXPerf220 eportRXPerf221 eportRXPerf222 eportRXPerf223 BehaviorType Triggered 1 Triggered 1 Triggered 1 Triggered 1 Triggered 1 Triggered 1 Triggered 1 Triggered 1 BehaviorInt Threshold boundary level is setat : Custom DefaultCustom Unit Percentage(%) Time base minuteminute Low 0 0 High 100 80 BufSize 0 0 Percentage(%) Threshold alarmlevel is set at: Defaul
Fabric Watch notification DefaultCustom Unit Percentage(%) Time base minuteminute Low 0 0 High 100 80 BufSize 0 0 6 Percentage(%) Threshold alarmlevel is set at: Custom . . . 3. Type 16 at the Select choice => prompt to apply the threshold alarm level changes. Unless you apply the value, it does not take effect.
6 Fabric Watch notification Showing mail configuration information 1. Type 1 in the fwMailCfg menu to view the current e-mail configuration classes. The configShow menu displays.
Fabric Watch notification 6 Enabling an e-mail alert 1. Type 3 in the fwMailCfg menu to enable e-mail alert for a specific class. The configShow menu displays. 2. Select a class for which Fabric Watch should enable e-mail alerts. The following confirmation message displays: Email Alert is enabled! If the class does not have an e-mail configuration (there is no e-mail address assigned to the class), the following error message displays: Mail configuration for class Environment is not done.
6 Fabric Watch notification Setting recipient mail address for e-mail alert 1. Type 5 in the fwMailCfg menu to specify the recipient to whom Fabric Watch should send the e-mail alert for a class. The configShow menu displays. 2. Select a class. The following prompt displays: Mail To: [NONE] Enter the e-mail address of the person responsible for the specific class of alerts. Fabric Watch uses the default value, located between the brackets in the prompt, as the current e-mail address for the class.
Fabric Watch notification 6 Removing the relay host configuration 1. Type 6 in the fwMailCfg menu to display the relay host configuration menu. 1 2 3 4 Display Relay Host configuration Set Relay Host IP Remove Relay Host configuration Quit 2. Type 3 to remove the configuration.
6 60 Fabric Watch notification Fabric Watch Administrator’s Guide 53-1001342-01
Chapter 7 Port fencing In this chapter • Configuring port fencing using the fwConfigure command . . . . . . . . . . . . . 61 • Configuring port fencing using the portFencing command . . . . . . . . . . . . . 65 Configuring port fencing using the fwConfigure command The Port Fencing feature, which can be set for the Port class, E_Port class, and FOP_ Port class only, is an optional procedure. The allowed threshold configuration settings are displayed on a per-class basis.
7 Configuring port fencing using the fwConfigure command 4. Select an area (areas 1 - 2 and 4 - 6 are available for Port Fencing). 1 : Link loss (E-port) 2 : Sync loss (E-port) 3 : Signal loss (E-port) 4 : Protocol error (E-port) 5 : Invalid words (E-port) 6 : Invalid CRCS (E-port) 7 : RXPerformance(E-port) 8 : TXPerformance (E-port) 9 : State Changes (E/VE-port) 10 : Link reset (E-port) 11 : Utilization (VE-port) 12 : Packet loss (VE-port) 13 : C3TX_TO 14 : return to previous page Select an area => : (1.
Configuring port fencing using the fwConfigure command 7 8. Verify that the alarm matrix displays the Above Custom as 32, and then change the Threshold alarm level to custom by typing 11.
7 Configuring port fencing using the fwConfigure command 12. Change the Threshold boundary level to custom by typing 3, and then select custom by typing 2 at the Enter boundary level type.
Configuring port fencing using the portFencing command 7 Configuring port fencing using the portFencing command Use the portFencing command to enable or disable port fencing on a specified E_Port, FOP_Port, VE_Port, or Port. 1. Connect to the switch and log in as admin. 2. Enter the portFencing command to display the list of operands. The portFencing menu displays.
7 66 Configuring port fencing using the portFencing command Fabric Watch Administrator’s Guide 53-1001342-01
Chapter Advanced configuration 8 In this chapter • Configuring advanced options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 • Advanced configuration options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69 Configuring advanced options During your planning activities, you should determine exactly which elements or monitors you want to configure, and in which class they reside. After you have made this decision, you need to identify the classes. 1.
8 Configuring advanced options 4. Type the number corresponding to the area that you want to configure, such as 6 for Invalid CRCs.
Advanced configuration options 8 Advanced configuration options To customize Fabric Watch monitoring to suit your environment, use the advanced configuration options, which are listed in Table 12. Table 12 describes the customization options displayed at the end of the Advanced Configuration menu. With the exception of the last option, which exits advanced configuration mode, each option has similar behavior.
8 Advanced configuration options TABLE 12 Advanced configuration options Option Effect Input information change changed alarm Changes the notification method for changed event occurrences for this method, but only affects the custom column. The required notification methods change above alarm Changes the notification method for above event occurrences for this method, but only affects the custom column.
Chapter 9 Fabric Watch Reports In this chapter • Fabric Watch reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Switch Availability Monitor (SAM) report . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Switch Health report . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Switch Status Policy report . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Port Detail report . . . . . .
9 Switch Availability Monitor (SAM) report Switch Availability Monitor (SAM) report The switch availability monitor (SAM) report lets you see the uptime and downtime for each port. It also enables you to check if a particular port is failing more often than the others. NOTE SAM report details do not display the health status of GbE ports. Fabric Watch only monitors and reports the status for physical and virtual FC ports.
Switch Health report 2/11 2/12 2/13 2/14 2/15 3/0 3/1 3/2 3/3 3/4 3/5 3/6 3/7 3/8 3/9 3/10 . . . T LB LB U LB T U U U U U U U U U VE 100 100 100 0 100 100 0 0 0 0 0 0 0 0 0 100 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 100 0 0 100 100 100 100 100 100 100 100 100 0 Switch Health report The Switch Health report lists the following information: • Current health of each port, based on the currently-configured policy settings.
9 Switch Status Policy report WWN servers monitor Standby CP monitor Standby CP monitor Core blade monitor Blades monitor Flash monitor Marginal ports monitor Faulty ports monitor Missing SFPs monitor HEALTHY HEALTHY HEALTHY HEALTHY HEALTHY HEALTHY HEALTHY HEALTHY HEALTHY All ports are healthy The final portion of the report, detailing port health, is not available without a Fabric Watch license. Switch Status Policy report The Switch Status Policy report displays the current policy parameter.
Port Detail report 9 Port Detail report If the Switch Health report shows marginal throughput or decreased performance, use the Port Detail report to see statistics on each port. The Port Detail report is a Fabric Watch licensed product. You can also see port details by health. For example, you can see only healthy ports, only marginal ports, only faulty ports, or only offline ports. The following is an example of a Port Detail report.
9 Port Detail report 216 217 218 219 220 221 222 223 VE VE VE VE VE VE VE VE HEALTHY HEALTHY HEALTHY HEALTHY HEALTHY HEALTHY HEALTHY HEALTHY 061:19 061:19 061:19 003:37 002:48 061:19 061:19 061:19 - - - - - - - - - - - - - NOTE Output of the Port Detail Report depends on the ports that belong to the current Admin Domain context. If a port does not belong to the current Admin Domain, nothing other than port number is displayed for that port.
Chapter Switch and FRU configuration 10 In this chapter • Switch status policy planning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 • FRU configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79 Switch status policy planning Before entering the switchStatusPolicySet command, plan your switch status policy. Determine your system requirements and the factors that affect its monitors.
10 Switch status policy planning Implementing your switch status policy After you planned and defined your switch status policy, implement it using the following procedure. 1. Enter the switchStatusPolicySet command to configure each policy. Each policy has two parameters that can be configured: Marginal and Down. 2. Set the number of units Marginal or Down based on your system requirements for each policy or parameter.
FRU configuration 10 FRU configuration The configuration of FRUs is an exception to the procedures described thus far in this chapter. FRUs are monitored using state values, as opposed to the quantitative values used to monitor the rest of the fabric. As a result of the qualitative nature of this monitoring, the concept of thresholds does not apply. 1. Establish a Telnet connection with a switch. 2. Log in using administrative privileges. 3. Enter the fwFruCfg command at the command prompt.
10 FRU configuration Specifying triggers for alarms You can specify triggers for any number of alarm states or alarm actions. The first prompt enables you to select which FRU states trigger events. 1. Add the numbers beside each state (for the states you want to include). 2. Enter the total at the prompt. For example, to trigger events using the Absent, Off, and Faulty states, add the assigned values and enter that value at the prompt.
Chapter System monitoring 11 In this chapter • System monitoring using the sysMonitor command . . . . . . . . . . . . . . . . . . . 81 System monitoring using the sysMonitor command The sysMonitor command enables you to manage your system’s memory or CPU usage. To execute this command, you must have chassis-level permission in a virtual fabric (VF) environment. System monitoring is disabled by default.
11 System monitoring using the sysMonitor command where: --config mem Configures the system’s CPU or memory usage monitoring parameters. Configures the system’s memory usage monitoring parameters. poll|retry|limit|action • poll - Specifies the polling interval. The valid values are between 10 • • • cpu seconds and 60 seconds. The default value is 10. retry - Specifies the number of retries before Fabric Watch takes action. The default value is three. limit - Specifies the high threshold.
System monitoring using the sysMonitor command 11 sysMonitor command examples Configuring the system memory usage monitoring threshold switch:admin > sysMonitor --config mem -poll 10 -retry 1 -limit 20 -action snmp,raslog Displaying the current memory usage threshold switch:admin > sysMonitor --show mem Showing Memory Usage: Used Memory :110515k 43% Total Memory : 257012k Free Memory : 146497k Used Memory Limit :60% Polling Interval :10 No of Retries :3 Actions : none Configuring the system CPU usage mo
11 84 System monitoring using the sysMonitor command Fabric Watch Administrator’s Guide 53-1001342-01
Appendix A Fabric Watch commands In this appendix The following table displays the Fabric Watch commands. Many of these commands are used in advanced configuration. For more information about how to use these commands, refer to Chapter 6, “Fabric Watch basic configurations”.
A 86 In this appendix Fabric Watch Administrator’s Guide 53-1001342-01
Appendix Default Settings B In this appendix • Fabric Watch default settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87 • Environment class default settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88 • Fabric class default settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90 • Performance Monitor class default settings . . . . . . . . . . . . . . . . . . . . . . . . . 91 • Port class default settings . . . . . .
B Class default settings Environment class default settings Table 16 provides default Environment class settings for all switches. Check the appropriate hardware reference manual for differences in actual environmental requirements. NOTE Fabric Watch no longer supports fan monitoring. Event Manager (EM) now manages fan monitoring and the switch status is calculated based on the fan status reported by EM.
Class default settings TABLE 16 Area B Environment class default settings (Continued) Description Default threshold settings Default alarm settings Threshold state Brocade 48000 Low: 0 High: 60 Buffer: 10 Brocade DCX Low: 0 High: 70 Buffer: 10 Brocade DCX-4S Low: 0 High: 75 Buffer: 10 Power Supply Fabric Watch Administrator’s Guide 53-1001342-01 Monitors power supply condition Time Base: None Low: 1 High: 0 Buffer: 0 Informative Out-of-range In-range Informative Changed: 0 Below: 3 Above: 3 In-Be
B Class default settings Fabric class default settings Table 17 provides default settings for areas in the Fabric class.
Class default settings B Performance Monitor class default settings Table 18 provides default settings for areas in the Customer-Defined Performance Monitor class.
B Class default settings Port class default settings Table 20 provides default settings (per minute) for areas in the Port class. TABLE 20 92 Port class default settings Area Description Default threshold settings Default alarm settings Threshold state Class 3 Discards Class 3 discards frames due to timeout or destination unreachable.
Class default settings TABLE 20 Port class default settings (Continued) Area Description Default alarm settings Threshold state Receive (Rx) Performance Monitors receive rate, Unit: Percentage (%) by percentage Time Base: minute Low: 0 High: 100 Buffer: 0 Changed: 0 Below: 0 Above: 0 In-Between: 0 Informative Informative Informative Informative State Changes Monitors state changes Changed: 0 Below: 0 Above: 0 In-Between: 0 Informative Informative Out_of_range In_range Transmit (Tx) Performanc
B Class default settings E_Port class default settings Table 21 provides default settings for areas in the E_Port class.
Class default settings TABLE 21 E_Port class default settings (Continued) Area Description Primitive Sequence Protocol Error Monitors the number Unit: Errors of primitive sequence Time Base: minute Low: 0 errors High: 5 Buffer: 0 Default threshold settings Default alarm settings Threshold state Changed: 0 Below: 0 Above: 0 In-Between: 0 Informative Informative Out_of_range In_range Receive Performance Monitors the receive rate, by percentage Unit: Percentage (%) Time Base: minute Low: 0 High: 1
B Class default settings FOP_Port class default settings Table 22 provides default settings for areas in the F/FL_Port class.
Class default settings TABLE 22 B FOP_Port class default settings (Continued) Area Description Default threshold settings Default alarm settings Threshold state Link Failure Count Monitors the number of link failures Unit: Errors Time Base: minute Low: 0 High: 500 Buffer: 50 Changed: 0 Below: 0 Above: 0 In-Between: 0 Informative Informative Out_of_range In_range Loss of Signal Count Monitors the number of signal loss errors Unit: Errors Time Base: minute Low: 0 High: 5 Buffer: 0 Changed: 0
B Class default settings Resource class default settings Table 24 provides default settings for areas in the Resource class.
Class default settings TABLE 25 Security class default settings (Continued) Area Description Default threshold settings Default alarm settings Invalid Certificates Monitors invalid certificates Unit: Violations Time Base: minute Low: 1 High: 2 Buffer: 0 Changed: 0 Below: 0 Above: 3 In-Between: 0 Informative Informative Out_of_range In_range Invalid Signatures Monitors invalid signatures Unit: Violations Time Base: minute Low: 1 High: 2 Buffer: 0 Changed: 0 Below: 0 Above: 3 In-Between: 0 Info
B Class default settings TABLE 25 100 Security class default settings (Continued) Area Description Default threshold settings Default alarm settings SLAP Bad Packets Monitors SLAP bad packets Unit: Violations Time Base: minute Low: 1 High: 2 Buffer: 0 Changed: 0 Below: 0 Above: 3 In-Between: 0 Informative Informative Out_of_range In_range SLAP Failures Monitors SLAP failures Unit: Violations Time Base: minute Low: 1 High: 2 Buffer: 0 Changed: 0 Below: 0 Above: 3 In-Between: 0 Informative Inf
Class default settings B SFP class default settings Table 26 provides default settings for areas in the SFP class. NOTE SFPs connected to GbE ports are not monitored.
B 102 Class default settings Fabric Watch Administrator’s Guide 53-1001342-01
Appendix C portThConfig examples In this appendix • portThConfig command shortcuts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Port Type: Port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Port Type: E_Port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . • Port Type: FOP_Port. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
C Port Type: Port Port Type: Port The remainder of this appendix provides specific examples for port and area types. Note that the shortcuts shown in Table 27 are used in the examples. NOTE The --apply command applies the settings and values.
Port Type: Port C Area Type: LOS portthconfig --set port -ar los -h -va 3 -tr above -ac raslog,snmp,email,portlog portthconfig --set port -ar los -h -tr below -ac raslog,snmp,email,portlog portthconfig --set port -ar los -l -va 1 -tr below -ac raslog,snmp,email,portlog Area Type: LinkFailure portthconfig --set port -ar lf -h -va 3 -tr above -ac raslog,snmp,email,portlog portthconfig --set port -ar lf -h -tr below -ac raslog,snmp,email,portlog portthconfig --set port -ar lf -l -va 1 -tr below -ac raslog,s
C Port Type: E_Port Port Type: E_Port Area Type: CRC portthconfig --set e-port -ar crc -h -va 6 -tr above -ac raslog,snmp,email,portlog portthconfig --set e-port -ar crc -h -tr below -ac raslog,snmp,email,portlog portthconfig --set e-port -ar crc -l -va 1 -tr below -ac raslog,snmp,email,portlog Area Type: ITW portthconfig --set e-port -ar itw -h -va 25 -tr above -ac raslog,snmp,email,portlog portthconfig --set e-port -ar itw -h -tr below -ac raslog,snmp,email,portlog portthconfig --set e-port -ar itw -l
Port Type: E_Port C Area Type: LOS portthconfig --set e-port -ar los -h -va 3 -tr above -ac raslog,snmp,email,portlog portthconfig --set e-port -ar los -h -tr below -ac raslog,snmp,email,portlog portthconfig --set e-port -ar los -l -va 1 -tr below -ac raslog,snmp,email,portlog Area Type: LinkFailure portthconfig --set e-port -ar lf -h -va 3 -tr above -ac raslog,snmp,email,portlog portthconfig --set e-port -ar lf -h -tr below -ac raslog,snmp,email,portlog portthconfig --set e-port -ar lf -l -va 1 -tr belo
C Port Type: FOP_Port Port Type: FOP_Port Area Type: CRC portthconfig --set fop-port -ar crc -h -va 3 -tr above -ac raslog,snmp,email,portlog portthconfig --set fop-port -ar crc -h -tr below -ac raslog,snmp,email,portlog portthconfig --set fop-port -ar crc -l -va 1 -tr below -ac raslog,snmp,email,portlog Area Type: ITW portthconfig --set fop-port -ar itw -h -va 25 -tr above -ac raslog,snmp,email,portlog portthconfig --set fop-port -ar itw -h -tr below -ac raslog,snmp,email,portlog portthconfig --set fop-
Port Type: FOP_Port C Area Type: LinkFailure portthconfig --set fop-port -ar lf -h -va 3 -tr above -ac raslog,snmp,email,portlog portthconfig --set fop-port -ar lf -h -tr below -ac raslog,snmp,email,portlog portthconfig --set fop-port -ar lf -l -va 1 -tr below -ac raslog,snmp,email,portlog Area Type: RX portthconfig --set fop-port -ar rx -h -va 3 -tr above -ac raslog,snmp,email,portlog portthconfig --set fop-port -ar rx -h -tr below -ac raslog,snmp,email,portlog portthconfig --set fop-port -ar rx -l -va
C 110 Port Type: FOP_Port Fabric Watch Administrator’s Guide 53-1001342-01
Appendix D Port fencing types The following table lists and describes the set of port fencing types that are available in M-EOS and Fabric OS v6.3.0. Fencing Type Violation Subtype Description Firmware Class / Area FOS Support Security Port Binding The login server detects a Port Binding violation when an attached device attempts to FLOGI with a port name WWN that does not match the WWN in the Port Binding configuration for that F_Port.
Port fencing types Fencing Type Violation Subtype Description Protocol ISL Segmentation An E_Port has segmented, exceeding the threshold limit. Security ISL Security Error The attached switch previously placed in the Invalid Attachment state has persisted in consuming switch resources and has violated the threshold limit of ISL Security Errors. This is similar to Authentication subtype.
Index A above event triggers, 23 activating Fabric Watch, 27 alarms continuous, 3, 49 triggered, 3, 49 API notification method, 51 area environment class, 13 fabric class, 13 FRU class, 14 performance monitor class, 15 port class, 15 resource class, 16 security class, 17 SFP class, 18 areas, 13 commands configdownload, 34 configUpload, 34 configupload, 34 fwclassinit, 28 fwconfigreload, 34 portFencing, 65 portThConfig, 38 snmpConfig, 50 sysMonitor, 81 continuous event behavior, 49 D data values, 4 defaul
Fabric Watch activation, 27 components, 1, 11 description of, 1 interface types, 27 notification methods, 50 thresholds, 19 fencing, port types, 111 FRU class areas, 14 I in-between triggers, 25 interface types, 27 N notification configuration alarms, 52 API, 51 relaying host IP configuration, 58 values, 53 notification methods, 2, 50 API, 51 e-mail, 55 e-mail alert, 51 event log entry, 3 port log lock, 51 RAPI trap, 51 SNMP, 3 SNMP trap, 50 P performance monitor class areas, 15 port class areas, 15 port
