aTCA-RN720 Rear Transition Module with two QSFP and four SFP+ service ports. Users Guide Manual Revision: Revision Date: Part Number: 1.00 November 6, 2013 50-1G031-1000 Advance Technologies; Automate the World.
aTCA-RN720 User's Guide Revision History Version Number 1.
aTCA-RN720 User's Guide Preface Copyright 2013 ADLINK Technology, Inc. This document contains proprietary information protected by copyright. All rights are reserved. No part of this manual may be reproduced by any mechanical, electronic, or other means in any form without prior written permission of the manufacturer.
aTCA-RN720 User's Guide Table of Contents 1 Introduction ............................................................................................................ 9 2 Summary of Specifications ................................................................................. 10 3 External Interfaces ............................................................................................... 11 3.1 3.2 3.3 3.4 4 Front Panel Overview ...............................................................
aTCA-RN720 User's Guide 7 Module Management Controller.......................................................................... 36 7.1 Overview ......................................................................................................... 36 7.2 Features and Functions .................................................................................. 37 7.3 MMC Control Operation .................................................................................. 37 7.4 Sensor Threshold Values....
aTCA-RN720 User's Guide List of Figures Figure 3-1 aTCA-RN720 Faceplate............................................................................... 11 Figure 4-1 Header J1 and Switch SW1 ......................................................................... 14 Figure 4-2 Header J15 .................................................................................................. 15 Figure 4-3 Injector (Bottom side)...................................................................................
aTCA-RN720 User's Guide List of Tables Table 1-1 Glossary .......................................................................................................... 9 Table 2-1 aTCA-RN720 Specifications.......................................................................... 10 Table 3-1 Faceplate LEDs and Markers........................................................................ 12 Table 3-2 Zone 3 Connector Pin-out: P1.......................................................................
aTCA-RN720 User's Guide 1 Introduction The aTCA-RN720 is a Rear Transition Module that provides two QSFP and four SFP+ service ports. The aTCA-RN720 is designed to be paired with the aTCA-N700 Traffic Management Blade, but it can be paired with any front blade which shares the same Zone 3 specifications.
aTCA-RN720 User's Guide 2 Summary of Specifications Summarized in Table 2-1 is the specifications of the aTCA-RN720.
aTCA-RN720 User's Guide 3 External Interfaces The aTCA-RN720 has QSFP and SFP+ service ports and LED indicators available from the faceplate. The Zone 3 connectors connect to a front blade, the aTCA-N700 for example. 3.1 Front Panel Overview The face plate of the main blade has following components: z z z z LED-OOS: Out Of Service Indicator LED-Power Good: Power Good indicator LED-Hot Swap: Hot Swap Indicator Traffic Service Ports with LEDs: 2 QSFP and 4 SFP+ Ports Figure 3-1 aTCA-RN720 Faceplate 3.
aTCA-RN720 User's Guide Table 3-1 Faceplate LEDs and Markers Name Marker HS LED OOS LED Power GOOD LED E Service Port L/A Display Blue Solid Blue Short Blink Blue Long Blink OFF Red Solid Red Blink OFF Green Solid OFF Green Solid OFF Green On Green Blink OFF Description DC-DC Power OFF(M1) Hot swap Operation(M5/M6) Hot swap Operation(M2) Normal Operation(M3/M4) Out of Service(M1) Out of Service or Service Preparation (M5/M6) Normal Operation (M3/M4) Power GOOD Power Fail Enabled Not Enabled Link Up
aTCA-RN720 User's Guide Table 3-3 Zone 3 Connector Pin-out: P2 Pin No A7 Signal Name RTM_SFP_RX_P/N [0:3] RTM_SFP_TX_P/N [0:3] RTM_SFP_RX_P/N [4:7] RTM_SFP_TX_P/N [4:7] RTM_SFP_RX_P/N [8:11] RTM_SFP_TX_P/N [8:11] RTM_LED_CLK0 B7 RTM_LED_DATA0 O LED data from switch for the SFP+ ports C7 RTM_LED_CLK1 O LED control CLK from switch for the SFP+ ports D7 RTM_LED_DATA1 O LED data from switch for the SFP+ ports A1~H1 A2~H2 A3~H3 A4~H4 A5~H5 A6~H6 I/O Description I QSFP ports RX: Port 1 O QSF
aTCA-RN720 User's Guide 4 Installation and Operation Before installing the aTCA-RN720, make sure that the following are ready or checked to insure proper installation and operation: z An ATCA chassis with a reserved slot for the front blade and the aTCA-RN720. Note that any front blade with identical Zone 3 pin assignment can use the aTCA-RN720.
aTCA-RN720 User's Guide Figure 4-2 Header J15 4.1.2 DIP Switches SW1 is provided for MMC to select different I/O connection between ISP interface and UART interface during debugging phase. • • MMC to UART: Close pin 1 and pin2. MMC to ISP interface: Open pin 1 and pin2 4.2 Hardware Installation The steps required to install the aTCA-RN720 are the following: Front Blade installation, RTM plugging-in, Monitoring Station Connection, and Traffic Port connection. 4.2.
aTCA-RN720 User's Guide Step 5: When the chassis was powered up and in operation, during plugging-in the board (Hot Swap situation), the board starts booting up as soon as the handles is fully closed in Step 4. Figure 4-3 Injector (Bottom side) Figure 4-4 Plugging the Board After plugging in the board, make sure that the injector handle is locked into the hole on the faceplate. This will activate the hot swap switch and the booting will start.
aTCA-RN720 User's Guide 4.2.3 Console/Management PC Connection The aTCA-RN720 does not have its own faceplate outlet for the console connection. The management of the RTM is only through the front blade. 4.2.4 Service Port Connection 40G or 10G Ethernet traffic sources should be connected to corresponding QSFP or SFP+ ports via matching cable assemblies. 4.3 RTM Status Check at Bootloader When all the hardware installation is done, one is able to run the commands through the front blade monitoring port.
aTCA-RN720 User's Guide 4.3.1 I2C Mux Access To check the I2C Mux addresses select I2C bus 3 and check the MUX addresses at the Uboot prompt. =>i2c dev 3 =>i2c probe (*screen capture of the results) 4.3.2 SFP Module Access To check the SFP module status enable the corresponding MUX and check SFP eeprom info as the following.
aTCA-RN720 User's Guide (*screen capture of the results) 4.3.3 Retimer Access To check the Retimer status, refer to the following example. More specific parameter settings for the retimer should refer to Section 6.2 and GN2405A datasheet from Gennum.
aTCA-RN720 User's Guide /*retimer register read/write@address 0x9A /*retimer 0 =>i2c mw 0x73 0x0 0x8; i2c probe =>i2c md 0x16 0x9a 0x2 =>i2c mw 0x16 0x9a 0xcafe.2 =>i2c md 0x16 0x9a 0x2 =>i2c mw 0x16 0x9a 0x4415.2 =>i2c md 0x16 0x9a 0x2 (*screen capture of the results) /*retimer 1 =>i2c mw 0x73 0x0 0x9; i2c probe =>i2c md 0x16 0x9a 0x2 =>i2c mw 0x16 0x9a 0xcafe.2 =>i2c md 0x16 0x9a 0x2 =>i2c mw 0x16 0x9a 0x4415.
aTCA-RN720 User's Guide =>i2c md 0x16 0x9a 0x2 =>i2c mw 0x16 0x9a 0x4415.2 =>i2c md 0x16 0x9a 0x2 /*retimer 4 =>i2c mw 0x73 0x0 0xc; i2c probe =>i2c md 0x16 0x9a 0x2 =>i2c mw 0x16 0x9a 0xcafe.2 =>i2c md 0x16 0x9a 0x2 =>i2c mw 0x16 0x9a 0x4415.2 =>i2c md 0x16 0x9a 0x2 /*retimer 5 =>i2c mw 0x73 0x0 0xd; i2c probe =>i2c md 0x16 0x9a 0x2 =>i2c mw 0x16 0x9a 0xcafe.2 =>i2c md 0x16 0x9a 0x2 =>i2c mw 0x16 0x9a 0x4415.2 =>i2c md 0x16 0x9a 0x2 4.3.
aTCA-RN720 User's Guide 4.4 IPMI Command When the front blade is up and running the aTCA-RN720 is ready to receive commands from a shelf manager in the chassis. This section summarizes some command execution examples and their responses based on the factory environment. Actual commands may differ per different shelf manager at customer environment. 4.4.1 Deactivate and Activate One can deactivate and activate the aTCA-RN720 at any state. Attached below are the example runs. Step 1.
aTCA-RN720 User's Guide Step 3. Activate the FRU and check the status. 4.4.2 Reset One can execute cold reset. Attached below are the example runs.
aTCA-RN720 User's Guide Step 1. Run cold reset command at the shelf manager and check the status. 4.4.3 Hot Swap One can check proper Hot Swap operations of the RTM. Step 1. Make sure that RTM is in normal operation and open the RTM Hot-swap handle switch and wait until the RTM Blue LED is on. Check the FRU status and SEL log.
aTCA-RN720 User's Guide Step 2. Close the RTM Hot-swap handle switch and wait until the RTM Blue LED goes off. 4.4.4 Threshold Base Sensor Data Threshold base sensor data such as voltages and temperatures are available for access though a shelf manager as the following examples. Step 1. Execute following command to get the information about threshold base sensor data. (Discrete sensor data information is omitted).
aTCA-RN720 User's Guide 25
aTCA-RN720 User's Guide 4.4.5 Sensor Threshold Values Predefined threshold values for the sensors are available for access though a shelf manager as the following examples.
aTCA-RN720 User's Guide 4.4.6 FRU Information RTM FRU information is available for access as in the following example.
aTCA-RN720 User's Guide 4.4.7 Faceplate LED Face plate LEDs can be controlled by a shelf manager. See the following examples. Step 1. Make the OOS LED blink. Step 2. Make the RUN LED blink. 4.4.8 HPM Upgrade The MMC firmware can be upgraded by the IPMI tool. See the following example. >ipimtool.
aTCA-RN720 User's Guide 29
aTCA-RN720 User's Guide 5 Architecture Overview The aTCA-RN720 is composed of the several major components as illustrated in Figure 5-1: the MMC, the CPLD, the Retimers, the I2C Block and the QSFP/SFP+s. The QSFP/SFP+ optic ports and the Retimers GN2405A from Gennum play a major role in the data plane. The data plane components are connected via the 10G Serdes interface, where 10Gbps data rate is supported by a pair of Serdes lanes per port.
aTCA-RN720 User's Guide 6 Data Path: Ports and Retimers 6.1 Overview The retimers used on the board are essential to improve the 10Gbps SFI signal quality. According to SFF 8431 specification, the SFI signal may not reach from a front blade to an RTM SFP+ port or vice versa, at viable quality after traversing a Zone 3 connector and several vias on the lossy PCB. The retimer along with equalization features compensates such losses and reflections.
aTCA-RN720 User's Guide 6.2 The Retimer, GN2405A The GN2405A architecture is illustrated in Figure 6-2, showing quad entities for both RX and TX. The features of GN2405A are summarized as the following: • • • • • • • Quad Datacom Repeater / Retimer supporting four RX lanes and four TX lanes Continuous rate operation from 9.95Gb/s to 11.3Gb/s Support for 2.
aTCA-RN720 User's Guide • Loss of Signal (LOS): the device can control the de-assert threshold and the hysteresis for the LOS. The detailed setting may be found from the following list of tables in the datasheet.
aTCA-RN720 User's Guide 6.4 Port Mapping The front blade (aTCA-N700) service port numbers, Zone 3 signals and its corresponding retimers are mapped as shown in Table 6-1. A different front blade may have different port numbers.
aTCA-RN720 User's Guide 7 Module Management Controller 7.1 Overview Figure 7-1 shows the 7 Module Management Controller (MMC) and its associated components. The MMC is responsible for the RTM chassis management functions compliant to IPMI v2.0 specifications. The MMC interfaces with the IPMC on the front blade through the IPMB-L on the Zone 3 connector to exchange IPMI commands. The Interface with the CPLD is via the GPIO pins.
aTCA-RN720 User's Guide 7.2 Features and Functions Itemized below are the features and the functions of the MMC. • RTM Management 9 Intelligent RTM depends on the MMC. 9 MMC communicates with the front blade IPMC via IPMB-L through a Hot-swap buffer : FRU information and Commands are exchanged. • Programmable device(CPLD) Download Interface 9 The CPLD programming interface is connected to the MMC GPIO.
aTCA-RN720 User's Guide Cold Reset triggered by Shelf manager Figure 7-2 Cold Reset Procedure (s) Shelf manager sends RESET command to IPMC. ① IPMC converts the command into Cold reset signal to FPGA. ②FPGA sends Resets to LMP and all Devices including RTM. ③MMC in RTM receives the Reset and forward the Reset to selected devices in the RTM.
aTCA-RN720 User's Guide Deactivate Figure 7-3 Deactivate Procedure ⒮ Shelf manager sends Deactivate to IPMC. ① IPMC sends Deactivate to LMP via PAYLOAD Interface (UART). ② LMP completes the operation and sends the completion message via PAYLOAD Interface (UART) to IPMC. ③ IPMC initiates Power Down sequence to power off Front Blade and RTM.
aTCA-RN720 User's Guide RTM Deactivate Figure 7-5 RTM Deactivate Procedure ⒮ Shelf manager sends RTM Deactivate Command to IPMC. ①IPMC sends RTM Deactivate to LMP via PAYLOAD Interface (UART). ② LMP completes the operation and sends completion message to IPMC. ③ IPMC sends RTM Power OFF command to MMC via IPMB-L. ④ MMC completes RTM Power OFF operation and sends the completion message to IPMC. ⑤ IPMC turns off RTM Power 12V.
aTCA-RN720 User's Guide RTM Enable PAYLOAD Interface RTM Power ON RTM Power OK RTM Activate Figure 7-6 RTM Activate Procedure ⒮ Shelf manager sends RTM Activate to IPMC. ① IPMC turns on RTM Power 12V. ② IPMC sends RTM Power ON Command to MMC via IPMB-L. ③ MMC sends Power OK to IPMC. ④ IPMC sends RTM Enable to LMP via PAYLOAD Interface (UART).
aTCA-RN720 User's Guide Shutdown triggered by LMP LMP UART#1 Power Sequence P5(5) Power OFF IPMC Figure 7-7 Shutdown Procedure ⒮ LMP sends Shutdown Command to IPMC via PAYLOAD Interface (UART). ① IPMC initiates Power Down sequence to turn off Blade and RTM power.
aTCA-RN720 User's Guide Table 7-8 Signals: RTM Shutdown Procedure Signal name PAYLOAD Interface IPMC : P5(4),P5(5) Status RTM Shutdown Command - IPMI Message RTM Disable Indicator IPMB-L IPMC : P8(0),P8(1) IPMC : P1(4) IPMB-L MMC : PD(0),PD(1) MMC : PC(0) - IPMI Message RTM Power OFF - IPMI Message RTM Power OFF Done - IPMI Message RTM Power 12V OFF 0 : Power OFF 1 : Power ON RTM Power OFF - IPMI Message RTM Power OFF Done - IPMI Message RTM Internal Power OFF 0 : Power ON 1 : Power OFF Deactivate CMD
aTCA-RN720 User's Guide RTM Hot Swap Figure 7-10 RTM Hot Swap Procedure ⒮ RTM Hot swap switch open operation triggers a signal to MMC. ① MMC sends RTM Deactivate command to IPMC. ②IPMC forwards RTM Deactivate command to LMP via PAYLOAD Interface (UART). ③LMP completes the operation and sends the completion message to IPMC via PAYLOAD Interface (UART). ④IPMC sends RTM Power OFF to MMC via IPMB-L. ⑤MMC completes operation and sends the completion message to IPMC. ⑥ IPMC turns off RTM Power 12V.
aTCA-RN720 User's Guide 7.4 Sensor Threshold Values 7.4.1 Voltage Threshold The voltage monitoring sensors are installed as summarized in Table 7-11. Table 7-11 Sensor Voltage Threshold Title RTM2 +12V_A RTM2 +3.3V_MP RTM2 +3.3V Thresholds UNR : +15V UC : +14V UNC : +12.6V LNC : +11.4V LC : +4.5V LNR : N/A UNR : 3.78V UC : +3.6V UNC : +3.46V LNC : 3.135V LC : +3V LNR : N/A UNR : 3.6V UC : +3.465V UNC : N/A LNC : N/A LC : +3.135V LNR : N/A Hysteresis 0.1V 0.04V 0.04V 7.4.
aTCA-RN720 User's Guide 8 CPLD The CPLD is used for various control purposes. Shown in Figure 8-1 is the interconnections to the associated devices on the board. The CPLD connects to the front blade with LED DATA and interrupt request signal IRQ. The LED data[0:1] come from the front blade switch. The front blade forwards these multiplexed LED status (link, activity) signals to the QSFP/SFP+ status LEDs on the faceplate.
aTCA-RN720 User's Guide The LED indication is mapped to the LED data values as shown in Table 8-1. Table 8-1 LED Data and E and L/A LED Indication per Port LINK-EN 1 1 1 0 LINK 1 1 0 0 ACT 1 0 0 0 E status ON ON ON OFF Description Link-en/Act Link-en/Link Link-en/No Link Link Disable /No Link L/A status BLINK ON OFF OFF The LED DATA from the Zone 3 connector to the RTM is RTM_LED_DATA1. The aTCA-N700 front blade sends the stream as in Figure 8-2 where the ports are arranged as in Table 8-2.
aTCA-RN720 User's Guide Data Port No. Port 3 Port 4 Port 5 Port 6 Port 7 Port 8 Port 9 Port 10 Port 11 Port 12 ~Port 19 DataBit 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 Description ~ Don't care Switch Serdes No. Port Name.
aTCA-RN720 User's Guide 9 I2C The Zone 3 connector offers two I2C buses. I2C #1 (Conn P1_E2/F2: RTM_SCL/RTM_SDA) is from the front blade IPMC for IPMB-L connection and I2C #2(Conn P2_G6/H6: LMP_SCL/LMP_SDA) is from the front blade switch for the SFP+ port link control. • I2C #1 is connected only to the MMC on the RTM. • I2C #2 is connected to the I2C switch for the front blade switch to control SFP related information (configuration and status gathering) directly or through the I2C IO Buffer.
aTCA-RN720 User's Guide The features of the PCA8575 are: • 400 kHz I2C-bus interface • 2.3 V to 5.5 V operation with 5.
aTCA-RN720 User's Guide 10 Power and Reset 10.1 Power Consumption Budget The RTM power consumption is estimated as in Table 10-1, where the total power consumption is well below the target maximum value 25 watts.
aTCA-RN720 User's Guide 10.2 Power Distribution The RTM receives the powers via a Zone 3 connector from the front blade. 12V and 3.3V_PRE are available from the Zone connector. The 3.3V_PRE is used for the MMC. The 12V is used as a source to generated necessary voltages including 3.3V on the board. Shown in Figure 10-1 is the RTM2 power distribution block diagram. Figure 10-1 Power Distribution 10.3 Power Sequencing The power sequencing and monitoring is done by the MMC. The MMC generates 3.
aTCA-RN720 User's Guide P1(H1) Zone 3 MMC_Enable MMC_RST ISP_RST (For programming) MMC RTM_Reset P1(H4) P1(E2/F2) IPMB_L(I2C) CPLD_RST RTM Logic Figure 10-3 Reset Tree 52 RST CPLD
aTCA-RN720 User's Guide 11 Outline 11.1 Board Outline Some of the board pictures are shown in Figure 11-1.
aTCA-RN720 User's Guide 11.2 Layer Stack-up The layering of the PCB is illustrated in Figure 11-2.The blade has 10layers of PCB laminate with FR408HR material, which has a low dielectric constant and low dissipation factor that are adequate to support 10Gbps SerDes signals. Design Specifications Design Specifications Lyrs: 1L(Ref 2L) & 10L(Ref 9L) Lyrs: Line: 5.30mil Line: Zo: 1 50Ω Tol: 10% Zd: 1L(Ref 2L) & 10L(Ref 9L) 3.70mil 100Ω Space: 6.
aTCA-RN720 User's Guide 12 References 1. aTCA-N700 Hardware User Manual Rev. 1.01, Oct.
aTCA-RN720 User's Guide Safety 1. Please read these safety instructions carefully. 2. Please keep this User‘s Manual for later reference. 3. One AC Inlets provided and service as Disconnect Devices, disconnect the equipment from both AC outlets use these AC Inlets before servicing or clearing. Use moisture sheet or cloth for cleaning. 4. For pluggable equipment, that the socket-outlet shall be installed near the equipment and shall be easily accessible. 5. Please keep this equipment from humidity. 6.
aTCA-RN720 User's Guide Getting Service ADLINK Technology, Inc. Address: 9F, No.166 Jian Yi Road, Zhonghe District New Taipei City 235, Taiwan Tel: +886-2-8226-5877 Fax: +886-2-8226-5717 Email: service@adlinktech.com Ampro ADLINK Technology, Inc. Address: 5215 Hellyer Avenue, #110, San Jose, CA 95138, USA Tel: +1-408-360-0200 Toll Free: +1-800-966-5200 (USA only) Fax: +1-408-360-0222 Email: info@adlinktech.com ADLINK Technology (China) Co., Ltd. Address: 300 Fang Chun Rd.
aTCA-RN720 User's Guide ADLINK Technology Japan Corporation Address: KANDA374 Bldg. 4F, 3-7-4 Kanda Kajicho, Chiyoda-ku, Tokyo 101-0045, Japan Tel: +81-3-4455-3722 Fax: +81-3-5209-6013 Email: japan@adlinktech.com ADLINK Technology, Inc. (Korean Liaison Office) Address: 8F Mointer B/D,1675-12, Seocho-Dong, Seocho-Gu, Seoul 137-070, Korea Tel: +82-2-2057-0565 Fax: +82-2-2057-0563 Email: korea@adlinktech.com ADLINK Technology Singapore Pte. Ltd.
