Brocade Fabric OS v7.3.0c Release Notes v1.0 October 28, 2014 Document History Document Title Summary of Changes Publication Date Brocade Fabric OS v7.3.0b Release Notes v1.0 Initial Release October 28, 2014 Fabric OS v7.3.0c Release Notes v1.
© 2014 Brocade Communications Systems, Inc. All Rights Reserved. ADX, AnyIO, Brocade, Brocade Assurance, the B-wing symbol, DCX, Fabric OS, ICX, MLX, MyBrocade, OpenScript, VCS, VDX, and Vyatta are registered trademarks, and HyperEdge, The Effortless Network, and The On-Demand Data Center are trademarks of Brocade Communications Systems, Inc., in the United States and/or in other countries. Other brands, products, or service names mentioned may be trademarks of their respective owners.
Contents Overview ...................................................................................................................................................... 5 New Hardware Support ........................................................................................................................................... 5 Summary of New Software Features ......................................................................................................................
Brocade HBA/Adapter Compatibility .................................................................................................................... 41 D_Port ..................................................................................................................................................................... 41 Encryption Behavior for the Brocade Encryption Switch (BES) and FS8-18 ...................................................... 42 FCIP (Brocade 7800 and FX8-24).......................
Overview FOS v7.3.0c is a patch release based on FOS v7.3.0b. All hardware platforms and features supported in FOS v7.3.0b are also supported in FOS v7.3.0a. This release contains a fix for a security vulnerability associated with OpenSSL. Software patches are apply to the existing version of OpenSSL packages. The detail of these patches are: • OpenSSL vulnerability: CVE-2014-3566 This release also contains a fix for the incorrect fan airflow display on Brocade 6505 and 6510.
• • • • • • • • • • • • • • Flow Vision enhancements o Flow Performance Monitor enhancements o Flow Mirror enhancements o Flow Generator enhancements o Miscellaneous Flow Vision enhancements ClearLink Diagnostic Port (D_Port) enhancements o D_Port and MAPS integration o Dynamic D_Port and On-demand D_Port on ISLs o D_Port Provision o D_Port test result display enhancements o D_Port on FC16-64 QSFPs Read Diagnostics Parameter (RDP) Link Cable Beacon (Port Peer Beacon) E_Port Balance Priority Routing enha
New Feature Descriptions New FCIP Features on Brocade 7840 In addition to the existing FCIP features supported on Brocade 7800 and FX8-24, FOS v7.3 supports the following new FCIP features on Brocade 7840. • • • • • • • • • • • • Support maximum 40G WAN throughput. Support maximum 20G bandwidth on a VE port. Non-disruptive firmware download. Fabric Vision for Extension. o ClearLink Diagnostic Port (D_Port) on all FC ports. o Monitoring and Alerting Policy Suites (MAPS) for FCIP QoS, tunnels, and circuits.
FOS v7.3 increase IPSec performance on Brocade 7840 with near line-rate throughput. FOS v7.3 implements IPSec configuration through a policy applied to a FCIP tunnel. IPSec supports both IPv4 and IPv6 and jumbo frames. Adaptive Rate Limiting (ARL) Enhancements FOS v7.3 implements two new ARL algorithms, Modified Multiplicative Decrease and Time-based Decrease, to provide additional performance tailored to network conditions.
two latency severity levels and provide intuitive reporting in MAPS dashboard under a new Fabric Performance Impact category. Monitor FCIP statistics FOS v7.3 supports new monitoring elements (RTT, Jitter) in the FCIP circuit group, adds a FCIP tunnel group to monitor tunnel state change and throughput, adds 4 FCIP tunnel QoS groups to monitor throughput and packet loss for each QoS priority.
FOS v7.3 extends the learning capability to Flow Monitor on E_Port and Ex_Port. FOS v7.3 also supports Flow Monitor for static and learning flows on XISL ports and backbone E_Port. These enhancements allow administrators to apply Flow Monitor function at all point of interests in most supported SAN topologies. Flow Mirror enhancements FOS v7.3 introduces Local Flow Mirror to mirror application flows to a mirror port on the same local switch where the flows are defined.
Read Diagnostics Parameters FOS v7.3 introduces the Read Diagnostics Parameters feature to support reporting diagnostics parameters associated with optics and media for any link between Nx_port and Fx_port from any point within a fabric. Administrators can use this ability to discover and diagnose link related errors or degrading conditions from a single point anywhere within a fabric. Link Cable Beacon (Port Peer Beacon) FOS v7.
FOS v7.3 upgrades a number of important open source software packages (openSSH, openSSL, Apache) to provide stronger security. Access Gateway Enhancements FOS v7.3 implements following Access Gateway (AG) enhancements. ClearLink Diagnostics (D_Port) Support on AG FOS v7.3 supports dynamic D_Port on connections between an AG and an HBA to allow automatically start D_Port test requested by an HBA. User Account and Password Distribution to AG FOS v7.
FOS v7.3 introduces firmware sync ability for the firmware on an active CP to be automatically synced to a standby CP after the standby CP is hot-plugged into a backbone switch chassis. Administrator can configure this ability on their chassis to enable quick operational replacement of a standby CP. Rolling Reboot Detection Enhancements FOS v7.3 enhances the rolling reboot detection feature to detect and stop a rolling reboot in disabled FOS switch state as a first attempt.
fosExec Remote Execution FOS v7.3 adds the ability to execute a FOS CLI command via fosExec CLI on a remote domain in the fabric. Administrators can enable this capability to execute CLI commands on multiple switches from a single switch in a fabric. CS_CTL QoS Enhancements FOS v7.3 enhances CS_CTL based QoS feature by reporting the CS_CTL auto mode in responses to device FLOGI, FDISC, and PLOGI requests. bottleneckMon CLI Change FOS v7.
Optionally Licensed Software Fabric OS v7.3 includes all basic switch and fabric support software, as well as optionally licensed software that is enabled via license keys. Optionally licensed features include: Brocade Ports on Demand—Allows customers to instantly scale the fabric by provisioning additional ports via license key upgrade. (Applies to select models of switches).
Adaptive Networking with QoS—Adaptive Networking provides a rich framework of capability allowing a user to ensure high priority connections obtain the bandwidth necessary for optimum performance, even in congested environments. The QoS SID/DID Prioritization and Ingress Rate Limiting features are the first components of this license option, and are fully available on all 8Gb and 16Gb platforms. Note : With FOS v7.
10GbE FCIP/10G Fibre Channel – This license enables the two 10GbE ports on the FX8-24 and/or the 10G FC capability on FC16-xx blade ports supported on DCX 8510 platforms except for the FC16-64 blade. On the Brocade 6510, Brocade 6520 this license enables 10G FC ports. This license is not applicable to Brocade 7840 or Brocade 6505.
WAN Rate Upgrade 2 License – The WAN Rate Upgrade 2 license provides unlimited WAN throughput (other than the hardware limit) on Brocade 7840. The WAN Rate Upgrade 2 licenses also enable the use of two 40GbE ports on Brocade 7840. The 40GbE ports cannot be configured without the WAN Rate Upgrade 2 license. A WAN Rate Upgrade 1 license must be installed on a Brocade 7840 before a WAN Rate Upgrade 2 license is installed.
Temporary License Support The following licenses are available in FOS v7.
Supported Switches FOS v7.3.0 supports the following platforms: • 300, 5100, 5300, 7800, VA-40FC, Brocade Encryption Switch, DCX, DCX-4S • 6510, 6505, 6520, 7840, DCX 8510-8, DCX 8510-4 • FC8-16, FC8-32, FC8-48, FC8-64, FX8-24, FS8-18, FCOE10-24 • FC16-32, FC16-48, FC16-64, FC8-32E, FC8-48E • 5410, M5424, 5430, 5431, 5432, 5450, 5460, 5470, 5480, NC-5480 • 6547, 6548, M6505 Access Gateway mode is also supported by Fabric OS v7.
• Switch operating system version • Error numbers and messages received • supportSave command output and associated files o For dual CP platforms running FOS v6.
FOS Migration Considerations This section contains important details to consider before migrating to or from this FOS release. FOS Upgrade and Downgrade Special Considerations DCX/DCX-4S units running any FOS v7.2.x can be non-disruptively upgraded to FOS v7.3.0c. This upgrade is non-disruptive to both FC and FCoE traffic (when using FCOE10-24 blades). Any firmware activation on Brocade 7800, or DCX, DCX-4S, DCX 8510-8, DCX 8510-4 with FX8-24 will disrupt I/O traffic on the FCIP links.
Important Notes This section contains information that you should consider before you use this Fabric OS release. Issues that may significantly impact testing of the new hardware platforms are captured in the Defect Tables at the end of this document. Brocade Network Advisor Compatibility Brocade Network Advisor greatly simplifies the steps involved in daily operations while improving the performance and reliability of the overall SAN and IP networking environment.
WebTools Compatibility FOS v7.3.0 is qualified and supported with Oracle JRE 1.7.0 update 60. Please refer to Other Important Notes and Recommendations section for more details. SMI Compatibility • It is important to note that host SMI-S agents cannot be used to manage switches running FOS v7.3. If users want to manage a switch running FOS v7.3 using SMI-S interface, they must use Brocade Network Advisor’s integrated SMI agent.
Supported Products and FOS Interoperability 48000 with FA4-18 blade(s), Brocade 7600 V6.2.2 or later 5 Mi10k, M6140 (McDATA Fabric Mode and Open Fabric Mode) Not Supported Multi-Protocol Router Interoperability Brocade 7500 and FR4-18i blade V6.2.2 and higher 3 5 7 McDATA SANRouters 1620 and 2640 Not Supported NOS (VDX Platform) Interoperability Brocade VDX6710, VDX6720, VDX6730 NOS v2.1.1 or later6 Brocade VDX8770 NOS 3.
FOS v6.4 FOS v6.4.1 or later If there are switches running FOS versions lower than the above listed patch levels in the same fabric as a switch with FOS v7.0 or later, then cfgsave and cfgenable operations initiated from these switches will fail if the zoning database is greater than 128KB. In such scenarios zoning operations such as cfgsave/cfgenable can still be performed successfully if initiated from a switch running FOS v7.0 or later. SNMP Support Starting with FOS v7.2.
FOS v7.3.0 Changes in SNMP MIBs and Objects This release introduces the following changes in MIBs and objects: New MIBs There are no new MIBs introduced in this release. Updated MIBs The following existing MIBs are supported for Brocade 7840 platform. • BRCD-FCIP-EXT-MIB Table Name fcipExtendedLinkTable Is Supported Description Yes This table contains statistical information about FCIP tunnel compression, retransmission, packet loss, and latency details.
ifRcvAddressTable No Not supported. MIB Objects fcipExtendedLinkTable This table contains statistical information about FCIP tunnel compression, retransmission, packet loss, and latency details. MIB Object and OID Description fcipExtendedLinkIfIndex The ifIndex value of the virtual interface corresponding to the FCIP tunnels running over TCP/IP. 1.3.6.1.4.1.1588.4.1.1.1 fcipExtendedLinkTcpRetransmits 1.3.6.1.4.1.1588.4.1.1.2 fcipExtendedLinkTcpDroppedPackets 1.3.6.1.4.1.1588.4.1.1.
This table contains statistical information about FCIP circuit and connection compression, retransmission, packet loss, and latency details. For Brocade 7840 platform this table shows only circuit stats. MIB Object and OID xfcipEntityId 1.3.6.1.4.1.1588.4.2.1.1 xfcipLinkIfIndex 1.3.6.1.4.1.1588.4.2.1.2 xfcipLinkIndex 1.3.6.1.4.1.1588.4.2.1.3 xfcipExtendedLinkTcpRetransmits 1.3.6.1.4.1.1588.4.2.1.4 xfcipExtendedLinkTcpDroppedPackets 1.3.6.1.4.1.1588.4.2.1.5 xfcipExtendedLinkTcpSmoothedRTT 1.3.6.1.4.1.1588.4.
MIB Object and OID ifPhysAddress .1.3.6.1.2.1.2.2.1.6 ifAdminStatus .1.3.6.1.2.1.2.2.1.7 ifOperStatus .1.3.6.1.2.1.2.2.1.8 ifLastChange .1.3.6.1.2.1.2.2.1.9 ifInOctets .1.3.6.1.2.1.2.2.1.10 ifInUcastPkts .1.3.6.1.2.1.2.2.1.11 ifInNUcastPkts .1.3.6.1.2.1.2.2.1.12 ifInDiscards .1.3.6.1.2.1.2.2.1.13 IfInErrors .1.3.6.1.2.1.2.2.1.14 ifInUnknownProtos .1.3.6.1.2.1.2.2.1.15 ifOutOctets .1.3.6.1.2.1.2.2.1.16 ifOutUcastPkts .1.3.6.1.2.1.2.2.1.17 ifOutNUcastPkts .1.3.6.1.2.1.2.2.1.18 ifOutDiscards .1.3.6.1.2.1.2.2.
ifXTable This table is enhance version of ifTable. MIB Object and OID ifName .1.3.6.1.2.1.31.1.1.1.1 ifInMulticastPkts .1.3.6.1.2.1.31.1.1.1.2 ifInBroadcastPkts .1.3.6.1.2.1.31.1.1.1.3 ifOutMulticastPkts .1.3.6.1.2.1.31.1.1.1.4 fOutBroadcastPkts .1.3.6.1.2.1.31.1.1.1.5 ifHCInOctets .1.3.6.1.2.1.31.1.1.1.6 ifHCInUcastPkts .1.3.6.1.2.1.31.1.1.1.7 ifHCInMulticastPkts .1.3.6.1.2.1.31.1.1.1.8 fHCInBroadcastPkts .1.3.6.1.2.1.31.1.1.1.9 ifHCOutOctets .1.3.6.1.2.1.31.1.1.1.10 ifHCOutUcastPkts .1.3.6.1.2.1.31.1.1.1.
MIB Object and OID Description ifConnectorPresent This object has the value 'true(1)' if the interface sublayer has a physical connector and the value false(2)' otherwise. .1.3.6.1.2.1.31.1.1.1.17 fcipEntityInstanceTable This table contains information related to FCIP entities. MIB Object and OID fcipEntityId 1.3.6.1.2.1.224.1.1.4.1.1 fcipEntityName 1.3.6.1.2.1.224.1.1.4.1.2 fcipEntityAddressType 1.3.6.1.2.1.224.1.1.4.1.3 fcipEntityAddress 1.3.6.1.2.1.224.1.1.4.1.4 fcipEntityTcpConnPort 1.3.6.1.2.1.
MIB Object and OID Description fcipLinkLocalFcipEntityAddressType 1.3.6.1.2.1.224.1.1.5.1.5 The address type. fcipLinkLocalFcipEntityAddress 1.3.6.1.2.1.224.1.1.5.1.6 The entity address. fcipLinkRemFcipEntityId 1.3.6.1.2.1.224.1.1.5.1.7 The remote entity identifier. fcipLinkRemFcipEntityAddressType 1.3.6.1.2.1.224.1.1.5.1.8 The remote entity address type. fcipLinkRemFcipEntityAddress 1.3.6.1.2.1.224.1.1.5.1.9 fcipLinkStatus 1.3.6.1.2.1.224.1.1.5.1.10 fcipLinkCreateTime 1.3.6.1.2.1.224.1.1.5.1.
Updated Traps The following BD traps are updated to include a new variable “slotPort” to display port number in slot/port format: • • bdTrap bdClearTrap Deprecated/Obsoleted MIBs The following MIB objects/traps in SW.mib are deprecated: • • • swTrackChangesInfo swTelnetShellAdmStatus swTrackChangesTrap Fabric OS v7.3.0c Release Notes v1.
Blade Support Fabric OS v7.3 software is fully qualified and supports the blades for the DCX/DCX-4S noted in the following table: DCX/DCX-4S Blade Support Matrix 16-, 32-, 48- and 64-port 8Gbit port blades (FC8-16, FC8-32, FC8-48, FC8-64) Supported with FOS v6.0 and above (FC8-64 requires FOS v6.4) with any mix and up to 8/4 of each. No restrictions around intermix. FC10-6 Not supported on FOS v7.1 or later Intelligent blade Up to a total of 8/4 intelligent blades.
Fabric OS v7.3 software is fully qualified and supports the blades for the DCX 8510-8 and DCX 8510-4 noted in the table below. DCX 8510-8/DCX 8510-4 Blade Support Matrix FC16-32, FC16-48 16G FC blades FOS v7.0 or later. FC16-64 blade2 FOS v7.3 or later. FC8-64 64 port 8Gbit port blade With any mix and up to 8/4 of each. No restrictions around intermix. Note: FC8-16, FC8-32, FC8-48 blades are not supported on DCX 8510 platforms. FC8-32E, FC8-48E1 FOS v7.0.1 or later.
Power Supply Requirements for Blades in DCX/DCX-4S Blades Type of Blade FC10-61, FC816, FC8-32, FC 8-48, FC864 Port Blade FR4-18i1 FS8-18, FX8-24, FCOE10-24 DCX/DCX-4S DCX/DCX-4S @110 VAC (Redundant configurations) @200-240 VAC (Redundant configurations) 2 Power Supplies 2 Power Supplies Intelligent Blade Not Supported 2 Power Supplies Intelligent Blade Not Supported DCX: 2 or 4 Power Supplies Comments • DCX-4S: 2 Power Supplies Distribute the Power Supplies evenly to 2 different AC con
Typical Power Supply Requirements Guidelines for Blades in DCX 8510-8 (For specific calculation of power draw with different blade combinations, please refer to Appendix A: Power Specifications in the 8510-8 Backbone Hardware Reference Manual) Configured Number of Ports Blades Type of Blade DCX 8510-8 @110 VAC (Redundant configurations) DCX 8510-8 @200-240 VAC (Redundant configurations) Comments Any combination of 8Gb or 16Gb ports with QSFP ICLs FC8-64, FC16-32, FC16-64, FC8-32E Port Blade 4 Powe
Typical Power Supply Requirements Guidelines for Blades in DCX 8510-8 (For specific calculation of power draw with different blade combinations, please refer to Appendix A: Power Specifications in the 8510-8 Backbone Hardware Reference Manual) Configured Number of Ports Blades Type of Blade DCX 8510-8 @110 VAC (Redundant configurations) DCX 8510-8 @200-240 VAC (Redundant configurations) Comments 384 16Gb ports + QSFP ICLs FC16-48 Port Blade Not Supported 4 Power Supplies 200-240VAC: For DCX 8510
Typical Power Supply Requirements Guidelines for Blades in DCX 8510-4 (For specific calculation of power draw with different blade combinations, please refer to Appendix A: Power Specifications in the 8510-4 Backbone Hardware Reference Manual) Configured Blades Number of Ports Type of Blade DCX 8510-4 @110 VAC (Redundant configurations) DCX 8510-4 @200-240 VAC (Redundant configurations) Comments 96 ports max with QSFP ICLs FC16-32, FC8-32E Port Blade 2 Power Supplies 2 Power Supplies 1+1 redunda
• Otherwise, the link will come up in normal mode. If FOS v7.2 or later is factory installed (or net installed), Adaptive Networking features are always available. This matches the behavior of the Brocade 6520 and all products shipping with prior versions of FOS and with the Adaptive Networking license factory installed. • Ports will come up in AE mode by default • If the remote port supports QOS and is not explicitly disabled, the link will come up in QOS mode.
Gen 5 platforms and blades are capable of setting an EHT value on an individual port basis. On 8G platforms EHT is set on an ASIC-wide basis, meaning all ports on a common ASIC will have the same EHT setting. Extra care should be given when configuring EHT on 8G platforms or Gen 5 platforms with 8G blades to ensure E_Ports are configured with an appropriate Hold Time setting. When using Virtual Fabrics and creating a new Logical Switch when running FOS v7.1.
• Gatekeeper LUNs used by SYMAPI on the host for configuring SRDF/TF using in-band management must be added to their containers with LUN state as “cleartext”, encryption policy as “cleartext” and without “-newLUN” option. • FOS7.2 and later supports KMIP key vault type for Thales e-Security Key Authority SW v4.0.0 KMIP servers. Please refer to the KMIP Encryption Admin Guide for more details. • Replication feature from Thales e-Security Key Authority KMIP server is not supported with BES/FS8-18.
portcfgge ge_num --set -channel The channel number can have a value of 1 through 102. The detailed explanation of the values are provided in the product data sheet at the following link: http://www.brocade.com/downloads/documents/data_sheets/product_data_sheets/10gbe-tunable-dwdm80km-sfp-ds.pdf • FCIP non-disruptive firmware download can fail in configurations with large FCIP object counts. This can occur in FICON or FCP emulation enabled configurations.
apply it once the firmware upgrade is completed to get the DCX/DCX-4S to the same startup configuration as in the older release. • It is recommended that Spanning Tree Protocol and its variants be disabled on CEE interfaces that are connected to an FCoE device. • The Fabric Provided MAC Address (FPMA) and the Fibre Channel Identifier (FCID) assigned to a VN_Port cannot be associated with any single front-end CEE port on which the FLOGI was received.
o Only supports FCoE direct attach. o Layer2 Ethernet traffic is not supported. o If an FCoE10-24 blade is inserted into a DCX 8510-8 chassis, it is required to reboot the chassis or slot poweroff/poweron core blades. A chassis reboot or slot poweroff/poweron core blades must also be performed if the FCoE10-24 blade is removed and replaced with another blade type. FCR and Integrated Routing • With routing and dual backbone fabrics, the backbone fabric ID must be changed to keep the IDs unique.
Flow Vision • • • • Users must not specify well known FC addresses, domain controller addresses or CUP Port ID (in FMS mode) for either the source or the destination device field while defining flows. Flow Vision does not support port swap. Users must not create flows on ports that are already swapped and users must not swap the ports on which the flows are currently defined. After a HA reboot, a flow generator flow can be created if the source or the destination port is F-Port.
• ISL R_RDY mode is not supported in a base switch with FOS version 7.0 or higher. WebTools • WebTools since FOS v7.1.0 has a “SupportSave” interface. It only collects, however, information specifics to WebTools. It does not contain the same information as collected by supportSave initiated through CLI or Brocade Network Advisor.
• POST diagnostics for the Brocade 5100 have been modified beginning with FOS v6.3.1b and v6.4.0 to eliminate an “INIT NOT DONE” error at the end of an ASIC diagnostic port loopback test. This modification addresses BL-1020 Initialization errors encountered during the POST portloopbacktest. (Defect 263200) • It is important to note that the outputs of slotshow –p and chassisShow commands also display the maximum allowed power consumption per slot.
are long distance port configurations that have used up all the credits prior to applying this fix, some long distance ports may experience degraded performance. • Firmware downgrade from FOS v7.3.0 will be blocked when any logical switch is configured with in-flight encryption with FCAP protocol or SHA-256 hashing algorithm is used with FCAP or DH-CHAP protocol. These configurations must be removed from all logical switches for downgrade.
Workaround: Disabling all problem ports with unstable light or fixing the speed of the port may help to limit the CPU load. Defect ID: DEFECT000528728 Technical Severity: Medium Probability: Medium Product: FOS Technology: Monitoring/RAS Reported In Release: FOS7.0.0 Technology Area: Logging Symptom: Raslog messages C3-1006 followed by a C3-1010 message may be seen on a switch with no further operational impact. Condition: Single bit correctable parity errors may cause these raslog events on 16G blades.
Defect ID: DEFECT000532108 Technical Severity: Medium Probability: Medium Product: FOS Technology: Security Reported In Release: FOS6.4.