ConnectX®-2 VPI Dual Port Adapter Card User Manual P/N: MHGH29B-XTR, MHGH29B-XSR Rev 1.1.5 www.mellanox.
Rev 1.1.5 NOTE: THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO(S) AND/OR THE SYSTEM USING IT.
ConnectX-2 VPI Card User Manual Rev 1.1.5 Table of Contents Table of Contents 3 List of Figures 4 List of Tables 5 Revision History 6 About this Manual 7 Intended Audience 7 Related Documentation 7 Online Resources 7 Document Conventions 7 Chapter 1 Overview 1.1 1.2 1.3 1.4 8 Adapter Cards Covered in this Manual Mellanox Part Numbering Legend Finding the GUID/MAC and Serial Number on the Adapter Cards Safety Warnings 9 10 11 11 Chapter 2 Adapter Card Interfaces 2.1 2.2 2.3 2.
Rev 1.1.
ConnectX-2 VPI Card User Manual Rev 1.1.
Rev 1.1.5 Revision History This document was printed on 7/1/10. Table 1 - Revision History Table 6 Date Rev July 1st, 2010 1.1.5 Added link to card table, June 28th, 2010 1.1.4 Removed single card graphic, June 22nd, 2010 1.1.3 Removed Gen 1 cards June 03th, 2010 1.1.2 Added Safety Warnings in Spanish May 13th, 2009 1.1.1 Minor formatting April 2009 1.1 New power numbers Oct. 2009 1.
ConnectX-2 VPI Card User Manual Rev 1.1.5 About this Manual This User Manual describes Mellanox Technologies ConnectX®-2 Dual Port VPI InfiniBand and Ethernet PCI Express x8 adapter cards. It provides details as to the interfaces of the board, specifications, required software and firmware for operating the board, and relevant documentation. Intended Audience This manual is intended for the installer and user of these cards.
Rev 1.1.5 1 Overview Overview This document is a User Manual for Mellanox Technologies VPI adapter cards based on the MT25408, ConnectX®-2 VPI integrated circuit device. The cards described in this manual have the following main features: • IEEE Std 802.3 compliant • PCI Express 2.0 (1.
ConnectX-2 VPI Card User Manual 1.1 Rev 1.1.5 Adapter Cards Covered in this Manual Table 3 lists the VPI adapter cards described in this manual. Table 3 - Adapter Cards Ordering Part Number (OPN) PCI Express SERDES Speed IB SDR / DDR/ QDR ETH Speed Short / Tall Bracket IC Part Number MHGH29B-XTR 5.0 GT/s DDR 1/10 Gb/s Tall MT25408B0-FCCR-GI MHGH29B-XSR 5.0 GT/s DDR 1/10 Gb/s Short MT25408B0-FCCR-GI Figure 1: CX4 InfiniBand VPI Adapter Card1 1. The cards have a similar form and fit.
Rev 1.1.5 1.2 Overview Mellanox Part Numbering Legend Table 4 describes the Mellanox Technologies adapter cards part numbering legend.
ConnectX-2 VPI Card User Manual 1.3 Rev 1.1.5 Finding the GUID/MAC and Serial Number on the Adapter Cards All Mellanox adapter cards have a label on the printed side of the adapter card that has the card serial number, the card MAC for Ethernet protocol, and the card GUID for InfiniBand protocol. VPI Cards have both a MAC and a GUID. For VPI cards the MAC is derived from the GUID.
Rev 1.1.5 Overview 5. Equipment Installation This equipment should be installed, replaced, or serviced only by trained and qualified personnel. 6. Equipment Disposal Disposal of this equipment should be in accordance to all national laws and regulations. 7. Local and National Electrical Codes This equipment should be installed in compliance with local and national electrical codes.
ConnectX-2 VPI Card User Manual Rev 1.1.5 2 Adapter Card Interfaces 2.1 I/O Interfaces Each adapter card includes the following interfaces: • 4X InfiniBand/Ethernet Copper ports • PCI Express x8 edge connector • I/O panel LEDs • I2C compatible connector (for debug) For dual port cards, port 1 connects to connector 1 of the device, while port 2 connects to connector 2 of the device. Figure 3: Port Numbering Port 1 Port 2 Dual Port 2.1.
Rev 1.1.5 Adapter Card Interfaces These ports utilize a ‘media detect circuit’ that applies power to active copper cables and fiber solutions connected to the port connectors. 2.1.2 Ethernet Interface The ConnectX®-2 device (MT25408B0) is compliant with the IEEE Std 802.3. VPI adapter cards (listed in Table 3 on page 9 ) based on this device provide access to the Ethernet ports by means of CX4 connectors. 2.1.
ConnectX-2 VPI Card User Manual Rev 1.1.5 The following configurations are supported by VPI: Table 5 - Supported Port configurations Port 1 Port 2 Ethernet Ethernet IB IB auto-sensing auto-sensing IB Ethernet IB auto-sensing auto-sensing Ethernet The following options are not supported: Table 6 - Unsupported Port Configurations Port 1 Port 2 Ethernet IB Ethernet auto-sensing auto-sensing IB 2.1.4 PCI Express Interface The ConnectX®-2 adapter cards support PCI Express 2.0 (1.
Rev 1.1.
ConnectX-2 VPI Card User Manual 2.2 Rev 1.1.5 Power All adapter cards receive 12V and 3.3V power from the PCI Express Edge connector. All other required power voltages are generated by on-board switch mode regulators. See “Specifications” on page 23. 2.3 Memory The adapter cards support multiple memory devices through the PCI Flash, and I2C compatible interfaces. 2.3.
Rev 1.1.5 Adapter Card Interfaces 2.4.
ConnectX-2 VPI Card User Manual 3 Driver Software and Firmware 3.1 Driver Software Rev 1.1.5 3.1.1 Linux For Linux, download and install the latest OpenFabrics Enterprise Distribution (OFED) software package available via the Mellanox Web site at: http://www.mellanox.com => Downloads => InfiniBand/VPI SW/Drivers. Follow the installation instructions included in the download package. 3.1.
Rev 1.1.5 Driver Software and Firmware open source EtherBoot/gPXE project (see www.etherboot.org). For more information go to http://www.mellanox.com > Products > InfiniBand/VPI SW/Drivers > FlexBoot.
ConnectX-2 VPI Card User Manual Rev 1.1.5 4 VPI Adapter Card Installation 4.1 Hardware and Software Requirements Before installing the adapter card, please make sure that the system meets the hardware and software requirements listed in Table 10. Refer to Chapter 3,“Driver Software and Firmware” on page 19 for download and installation instructions.
Rev 1.1.5 VPI Adapter Card Installation 4.3.1 Cable Installation All cables can be inserted or removed with the unit powered on. To insert a cable, press the connector into the port receptacle until the connector is firmly seated. The GREEN LED indicator will light when the physical connection is established (that is, when the unit is powered on and a cable is plugged into the port with the other end of the connector plugged into a functioning port).
ConnectX-2 VPI Card User Manual Rev 1.1.5 Appendix A: Specifications A.1 Board Mechanical Drawing and Dimensions All of the cards covered in this User Manual have the same mechanical drawing and share the same dimensions as depicted in Figure 8. All dimensions are in millimeters. Figure 8: Schematic of the ConnectX-2 VPI Adapter Card with CX4 Connectors J5 – I2C Connector J6 – Flash Jumper 136.47 57.16 64.40 15.00 33.35 43.17 57.15 3.65 1.90 96.3 A.
Rev 1.1.5 Table 11 - Adapter Cards Certification Status A.2.1 Card P/N FCC Class (USA) EN ICES VCCI IEC/EN Class Class (Japan) (Europe) (Canada) MHGH29B-XTR A A A A MHGH29B-XSR A A A A cTUVus CB FCC Statements (USA) Class A Statements: § 15.21 Statement Warning! Changes or modifications to this equipment not expressly approved by the party responsible for compliance (Mellanox Technologies) could void the user's authority to operate the equipment. §15.
ConnectX-2 VPI Card User Manual A.2.3 Rev 1.1.5 ICES Statements (Canada) Class A Statement: “This Class A digital apparatus complies with Canadian ICES-003. Cet appareil numérique de la classe A est conforme à la norme NMB-003 du Canada.” A.2.4 VCCI Statements (Japan) Class A Statement: (Translation - "This is a Class A product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment (VCCI).
Rev 1.1.5 A.3 MHGH29B-X[ST]R Specifications Table 12 - Specifications for MHGH29B-X[ST]R Physical Power and Environmental Size: Air Flow: 4X 20Gb/s Connector: 2.54in. x 5.37in. (64.4mm x 136.47mm) 200LFM @55°C InfiniBand (Copper, current rating: 0.5A max) with active media adapter support Voltage: Typ. Power: Passive cables 8.15W Active cables 10.15W Maximum Power: Passive cables 8.80W Active cables 10.
ConnectX-2 VPI Card User Manual Rev 1.1.5 Appendix B: Interface Connectors Pinout I2C-Compatible Connector Pinout Figure 9: Compatible Connector Plug and Pinout Table 13 - I2C-Compatible Connector Connector Pin Number Signal Name 1 SPSDA 2 SPSCL 3 GND 4 NC 5 NC 4 3 2 1 5 1 2 3 4 5 B.
Rev 1.1.5 B.
ConnectX-2 VPI Card User Manual Rev 1.1.5 Appendix C: Replacing a Tall Bracket With a Short Bracket This section provides instructions on how to remove the tall bracket of a standard Mellanox Technologies adapter card and replace it with a short one. It includes the following sections: • Removing a bracket • Installing a new bracket Figure 11 shows the bracket-side view of a card. Figure 11: Tall Bracket of a Dual IB Port Card C.
Rev 1.1.5 Figure 13: Extracting Connector Clip (a) Gently Push One Hook of (b) Gently Push Other Hook of Clip (c) Pull Clip Away 3. Repeat the above actions for the second connector’s clip. 4. Unscrew both screws from the card using a torque screwdriver as shown in Figure 15. Grip the bracket as shown in Figure 15, placing your thumb on the LED component.
ConnectX-2 VPI Card User Manual Rev 1.1.5 Figure 15: Rotate the Bracket to Detach it (a) Grip the Card in preparation for Detachment. (b) Rotate the bracket toward the Component Side. (c) Bracket Separated From Clips and Screws. C.2 Replacing a Bracket The short bracket can now be assembled onto the card. 1. Gently place the bracket onto the card fitting the connectors through the bracket connector holes. The tab on the bracket should be pointing in the same direction as the PCI connector.
Rev 1.1.5 Do not force the bracket onto the card. You may have to gently push the LEDs using a small screwdriver to align the LEDs with the holes in the bracket. Be careful not to break the LED pipes. 2. Insert a screw along with a washer into each of the two holes on the card, intended for holding the bracket. 3. Use a torque screwdriver to apply up to 2 lbs-in torque on each screw. Figure 17: Attach Bracket onto Card using Screws 4. Gently push the clip onto the connector.
ConnectX-2 VPI Card User Manual Rev 1.1.
Rev 1.1.5 Appendix D: Avertissements de sécurité d’installation (Warnings in French) 1. Instructions d’installation Lisez toutes les instructions d’installation avant de brancher le matériel à la source d’alimentation électrique. 2. Température excessive Ce matériel ne doit pas fonctionner dans une zone avec une température ambiante dépassant le maximum recommandé de 55°C (131°F). Un flux d’air de 200LFM à cette température ambiante maximale est nécessaire.
ConnectX-2 VPI Card User Manual Rev 1.1.5 Appendix E: Sicherheitshinweise (Warnings in German) 1. Installationsanleitungen Lesen Sie alle Installationsanleitungen, bevor Sie das Gerät an die Stromversorgung anschließen. 2. Übertemperatur Dieses Gerät sollte nicht in einem Bereich mit einer Umgebungstemperatur über der maximal empfohlenen Temperatur von °C (°F) betrieben werden. Es ist ein Luftstrom von 200 LFM bei maximaler Umgebungstemperatur erforderlich. Außerdem sollten mindestens 8 cm (3 in.
Rev 1.1.5 Appendix F: Advertencias de seguridad para la instalación (Warnings in Spanish) 1. Instrucciones de instalación Antes de conectar el equipo a la fuente de alimentación, leer todas las instrucciones de instalación. 2. Sobrecalentamiento No se debe utilizar el equipo en un área con una temperatura ambiente superior a la máxima recomendada: 45°C.
