Sun™ PCI-Express Dual Gigabit Ethernet MMF/UTP Adapter Installation and User’s Guide Sun Microsystems, Inc. www.sun.com Part No. 819-4090-11 June 2006, Revision A Submit comments about this document at: http://www.sun.
Copyright 2006 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved. Sun Microsystems, Inc. has intellectual property rights relating to technology that is described in this document. In particular, and without limitation, these intellectual property rights may include one or more of the U.S. patents listed at http://www.sun.com/patents and one or more additional patents or pending patent applications in the U.S. and in other countries.
Contents 1.
Features of the Sun PCI-Express Dual Gigabit Ethernet UTP ExpressModule 2. Installing the Adapter 13 Installing the Low-Profile Adapter 13 ▼ To Install the Low-Profile Adapter ▼ To Verify the Installation 13 14 Setting the local-mac-address Property Rebooting the System 18 Installing the ExpressModule Adapter 3.
Checking Configurations ▼ 30 To Check Layer 2 Configuration 31 Sun PCI-Express Dual Gigabit Ethernet Driver Operating Statistics kstat Statistics 33 Sun PCI-Express Dual Gigabit Ethernet Device Driver Parameters Operational Mode Parameters Flow Control Parameters 37 Interpacket Gap Parameters Interrupt Parameters Jumbo Frames 37 38 40 40 ▼ To Configure Jumbo Frames Using ndd ▼ To Configure Jumbo Frames in a Linux Environment Configuring e1000g Driver Parameters Hardware and Software Overvie
▼ A. To Configure Static VLANs Specifications Connectors 60 63 63 Low-Profile Performance Specifications Low-Profile Physical Characteristics Low-Profile Power Requirements 65 65 66 ExpressModule Performance Specifications ExpressModule Physical Characteristics ExpressModule Power Requirements 66 67 67 ExpressModule Environmental Requirements B.
▼ Index To Configure Bonding for Multiple e1000 Interfaces 86 87 Contents vii
viii Sun PCI-Express Dual Gigabit Ethernet MMF/UTP Adapter Installation and User’s Guide • June 2006
Regulatory Compliance Statements Your Sun product is marked to indicate its compliance class: • • • • Federal Communications Commission (FCC) — USA Industry Canada Equipment Standard for Digital Equipment (ICES-003) — Canada Voluntary Control Council for Interference (VCCI) — Japan Bureau of Standards Metrology and Inspection (BSMI) — Taiwan Please read the appropriate section that corresponds to the marking on your Sun product before attempting to install the product.
ICES-003 Class A Notice - Avis NMB-003, Classe A This Class A digital apparatus complies with Canadian ICES-003. Cet appareil numérique de la classe A est conforme à la norme NMB-003 du Canada. ICES-003 Class B Notice - Avis NMB-003, Classe B This Class B digital apparatus complies with Canadian ICES-003. Cet appareil numérique de la classe B est conforme à la norme NMB-003 du Canada.
BSMI Class A Notice The following statement is applicable to products shipped to Taiwan and marked as Class A on the product compliance label. Include the following BMSI DoC mark when requested to do so by Compliance Engineering. Use “D33012” or “T33012” as callout text to the right of the circled arrow(see example below). Remove unneeded text string. Group the text and graphic together. Otherwise, remove this paragraph, graphic, and alt text if not needed.
GOST-R Certification Mark xii Sun PCI-Express Dual Gigabit Ethernet MMF/UTP Adapter Installation and User’s Guide • June 2006
Safety Agency Compliance Statement Read this section before beginning any procedure. The following text provides safety precautions to follow when installing a Sun Microsystems product. Depending on the type of power switch your device has, one of the following symbols may be used: On – Applies AC power to the system. Off – Removes AC power from the system.
Caution – Not all power cords have the same current ratings. Do not use the power cord provided with your equipment for any other products or use. Household extension cords do not have overload protection and are not meant for use with computer systems. Do not use household extension cords with your Sun product. instructions provided in the product service manual. Do not disassemble batteries or attempt to recharge them outside the system. Do not dispose of batteries in fire.
■ Caution – To prevent extreme operating temperatures due to reduced airflow consideration should be made to the amount of air flow that is required for a safe operation of the equipment. Laser Compliance Notice Sun products that use laser technology comply with Class 1 laser requirements.
Symboles Vous trouverez ci-dessous la signification des différents symboles utilisés: Attention – Vous risquez d'endommager le matériel ou de vous blesser. Veuillez suivre les instructions. Attention – Surfaces brûlantes. Evitez tout contact. Les surfaces sont brûlantes. Vous risquez de vous blesser si vous les touchez. Positionnement d’un produit Sun Attention – Evitez d'obstruer ou de recouvrir les orifices de votre produit Sun.
L'avertissement suivant s'applique uniquement aux systèmes équipés d'un interrupteur Veille: Attention – L'interrupteur d'alimentation de ce produit fonctionne uniquement comme un dispositif de mise en veille. Le cordon d'alimentation constitue le moyen principal de déconnexion de l'alimentation pour le système. Assurez-vous de le brancher dans une prise d'alimentation mise à la terre près du système et facile d'accès.
Avis de conformité des appareils laser Symbole Les produits Sun qui font appel aux technologies lasers sont conformes aux normes de la classe 1 en la matière.
Aufstellung von Sun-Geräten Achtung – Geräteöffnungen Ihres SunProdukts dürfen nicht blockiert oder abgedeckt werden. Sun-Geräte sollten niemals in der Nähe von Heizkörpern oder Heißluftklappen aufgestellt werden. Die Nichtbeachtung dieser Richtlinien kann Überhitzung verursachen und die Zuverlässigkeit Ihres Sun-Geräts beeinträchtigen. SELV-Konformität Netzkabel an eine frei zugängliche geerdete Steckdose in der Nähe des Systems angeschlossen ist.
Gehäuseabdeckung Hinweis zur Laser-Konformität Sie müssen die Abdeckung Ihres Sun-Computersystems entfernen, um Karten, Speicher oder interne Speichergeräte hinzuzufügen. Bringen Sie vor dem Einschalten des Systems die Gehäuseabdeckung wieder an. Sun-Produkte, die die Laser-Technologie verwenden, entsprechen den Laser-Anforderungen der Klasse 1. Class 1 Laser Product Luokan 1 Laserlaite Klasse 1 Laser Apparat Laser Klasse 1 Achtung – Nehmen Sie Sun-Geräte nicht ohne Abdeckung in Betrieb.
Símbolos Colocación de un producto Sun En este documento aparecen los siguientes símbolos: Precaución – Existe el riesgo de que se produzcan lesiones personales y daños en el equipo. Siga las instrucciones. Precaución – Superficie caliente. Evite todo contacto. Las superficies están calientes y pueden causar lesiones personales si se tocan. Precaución – Voltaje peligroso. Para reducir el riesgo de descargas eléctricas y lesiones personales, siga las instrucciones.
hace las veces de dispositivo de desconexión principal del sistema. Asegúrese de que conecta el cable de alimentación a una toma de tierra situada cerca del sistema y de fácil acceso. No conecte el cable de alimentación si la unidad de alimentación no se encuentra en el bastidor del sistema. Precaución – No ponga en funcionamiento los productos Sun que no tengan colocada la cubierta. De lo contrario, puede sufrir lesiones personales y ocasionar daños en el sistema.
Aviso de cumplimiento de la normativa para la utilización de láser Danmark Los productos Sun que utilizan tecnología láser cumplen los requisitos establecidos para los productos láser de clase 1. Class 1 Laser Product Luokan 1 Laserlaite Klasse 1 Laser Apparat Laser Klasse 1 Dispositivos de CD y DVD Advarsel! – Litiumbatteri — Eksplosionsfare ved fejlagtig håndtering. Udskiftning må kun ske med batteri af samme fabrikat og type. Levér det brugte batteri tilbage til leverandøren.
xxiv Sun PCI-Express Dual Gigabit Ethernet MMF/UTP Adapter Installation and User’s Guide • June 2006
Declaration of Conformity Compliance Model Number: Product Family Name: 3008 Sun PCI-E Dual Gigabit Ethernet MMF (X7280A) EMC USA—FCC Class B This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: 1. This equipment may not cause harmful interference. 2. This equipment must accept any interference that may cause undesired operation.
xxvi Sun PCI-Express Dual Gigabit Ethernet MMF/UTP Adapter Installation and User’s Guide • June 2006
Declaration of Conformity Compliance Model Number: Product Family Name: 3009 Sun PCI-E Dual Gigabit Ethernet UTP (X7281A) EMC USA—FCC Class B This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: 1. This equipment may not cause harmful interference. 2. This equipment must accept any interference that may cause undesired operation.
xxviii Sun PCI-Express Dual Gigabit Ethernet MMF/UTP Adapter Installation and User’s Guide • June 2006
Preface The Sun™ PCI-Express Dual Gigabit Ethernet adapters consist of four cards: ■ ■ ■ ■ Sun Sun Sun Sun PCI-Express PCI-Express PCI-Express PCI-Express Dual Dual Dual Dual Gigabit Gigabit Gigabit Gigabit Ethernet Ethernet Ethernet Ethernet UTP Low Profile card MMF Low Profile card UTP ExpressModule MMF ExpressModule The Sun PCI-Express Dual Gigabit Ethernet Adapter Installation and User’s Guide provides installation instructions for all four cards.
Chapter 4 describes how to configure the e1000g driver parameters. Chapter 5 explains virtual local area networks (VLANs) and provides configuration instructions and examples. Appendix A lists the specifications for the Sun PCI-Express Dual Gigabit Ethernet adapter. Appendix B provides an overview of the SunVTS diagnostic application and instructions for updating the SunVTS software to recognize the adapter. Appendix C explains how to install the driver software in a Linux environment.
Typographic Conventions Typeface* Meaning Examples AaBbCc123 The names of commands, files, and directories; on-screen computer output Edit your.login file. Use ls -a to list all files. % You have mail. AaBbCc123 What you type, when contrasted with on-screen computer output % su Password: AaBbCc123 Book titles, new words or terms, words to be emphasized. Replace command-line variables with real names or values. Read Chapter 6 in the User’s Guide. These are called class options.
Related Documentation The documents listed as online are available at: http://www.sun.com/documentation Application Title Part Number Format Location Release Notes Sun PCI-Express Dual Gigabit Ethernet Adapter Release Notes 819-4091 PDF HTML Online Safety and compliance Safety and Compliance Manual 816-7190 PDF HTML Online Documentation, Support, and Training Sun Function URL Documentation http://www.sun.com/documentation/ Support http://www.sun.com/support/ Training http://www.sun.
Sun Welcomes Your Comments Sun is interested in improving its documentation and welcomes your comments and suggestions. You can submit your comments by going to: http://www.sun.
xxxiv Sun PCI-Express Dual Gigabit Ethernet MMF/UTP Adapter Installation and User’s Guide • June 2006
CHAPTER 1 Sun PCI-Express Dual Gigabit Ethernet Adapter Overview This chapter describes the Sun PCI-Express Dual Gigabit Ethernet hardware and software, and includes the following sections: ■ “Hardware Overview” on page 1 ■ “ExpressModule Hardware and Software Requirements” on page 8 ■ “Patches and Updates” on page 9 ■ “Features of the Sun PCI-Express Dual Gigabit Ethernet MMF Low-Profile Adapter” on page 9 ■ “Features of the Sun PCI-Express Dual Gigabit Ethernet UTP Low-Profile Adapter” on page
Sun PCI-Express Dual Gigabit Ethernet MMF Low-Profile Adapter The Sun PCI-Express Dual Gigabit Ethernet MMF adapter is a low-profile, dual-port Gigabit Ethernet fiber-optics PCI-Express adapter. It operates in 10/100/1000 Mbit/sec Ethernet networks. FIGURE 1-1 Sun PCI-Express Dual Gigabit Ethernet MMF Low-Profile Adapter LED Displays on the MMF Low-Profile Adapter Four LEDs are displayed on the front panel of Sun PCI-Express Dual Gigabit Ethernet MMF adapter. The LEDs are labeled as shown in TABLE 1-1.
TABLE 1-1 Front Panel Display LEDs for the MMF Low-Profile Adapter (Continued) Label Meaning if Lit Color Source LINK(1) Link is up Green I82571 (Circuit on board) ACT(0) Data is beeing transmitted or received Green I82571 (Circuit on board) LINK(0) Link is up Green I82571 (Circuit on board) Sun PCI-Express Dual Gigabit Ethernet UTP Low-Profile Adapter The Sun PCI-Express Dual Gigabit Ethernet UTP adapter is a low-profile, dual-port gigabit Ethernet copper-based PCI-Express adapter.
LED Displays on the UTP Low-Profile Adapter Four LEDs are displayed on the front panel of the Sun PCI-Express Dual Gigabit Ethernet UTP adapter.
Sun PCI-Express Dual Gigabit Ethernet MMF ExpressModule Adapter The Sun PCI-Express Dual Gigabit Ethernet MMF ExpressModule adapter is a dualport Gigabit Ethernet fiber-optics ExpressModule adapter. It operates in 10/100/1000 Mbit/sec Ethernet networks.
LED Displays on the MMF ExpressModule Adapter Two LEDs are displayed on the front panel of Sun PCI-Express Dual Gigabit Ethernet MMF adapter. They are labeled on the front panel as shown in TABLE 1-1. TABLE 1-4 Front Panel Display LEDs for the MMF ExpressModule Adapter Label Meaning if Lit Color Source PWR Power is on. Green ExpressModule connector ATN Attention required Amber ExpressModule connector ATNSW Attention Switch is a recessed pushbutton.
FIGURE 1-4 Sun PCI-Express Dual Gigabit Ethernet UTP ExpressModule Adapter LED Displays on the UTP ExpressModule Adapter Two LEDs are displayed on the front panel of the Sun PCI-Express Dual Gigabit Ethernet UTP ExpressModule adapter. They are labeled on the front panel as shown in TABLE 1-5. TABLE 1-5 Front Panel Display LEDs for the UTP ExpressModule Adapter Label Meaning if Lit Color Source PWR Power is on.
ExpressModule Hardware and Software Requirements Before using the Sun PCI-Express Dual Gigabit Ethernet ExpressModule, ensure that Iyour system meets the following hardware and software requirements:: TABLE 1-6 Requirements for the Sun PCI-Express Dual Gigabit Ethernet ExpressModule Adapter Driver Operating System Servers e1000g Solaris 10 x86 Operating System and future compatible releases Sun Blade X8000 e1000 RedHat Enterprise Linux 4.
Patches and Updates Check the Sun Update Connection to ensure that you have the latest recommended Patch Clusters and Security Patches. You can download the latest recommended Patch Clusters and Security Patches at: http://sunsolve.sun.com/pub-cgi/show.
Features of the Sun PCI-Express Dual Gigabit Ethernet UTP Low-Profile Adapter The Sun PCI-Express Dual Gigabit Ethernet UTP adapter addresses the following requirements, and provides additional features and benefits: ■ Provides a high-performance, highly integrated Ethernet LAN adapter for PCIExpress systems using x4 PCI-E. ■ Provides a dual RJ-45 connection for 10BASE-T, 100BASE-TX, and 1000BASE-T connectivity through standard CAT-5 cable. ■ Provides an out-of-band connection through a serial SMBus.
Features of the Sun PCI-Express Dual Gigabit Ethernet UTP ExpressModule ■ Meets single-wide PCI-Express ExpressModule form factor requirements. ■ Based on the Intel 82571EB 10/100/1000 Mbit/sec Ethernet controller. ■ Provides two 1 Gbps Ethernet ports. ■ Provides two single RJ45 connectors including LEDs and magnetics. ■ Provides I/O Diag, FCode, BootNet, and POST resources. ■ Provides EEPROM, AT25128A, 16 Kbyte, connected to 182571 SPI (serial EEPROM) bus.
12 Sun PCI-Express Dual Gigabit Ethernet MMF/UTP Adapter Installation and User’s Guide • June 2006
CHAPTER 2 Installing the Adapter This chapter describes how to install the adapter in your system and verify that it has been installed correctly. This chapter contains the following sections: ■ ■ “Installing the Low-Profile Adapter” on page 13 “Installing the ExpressModule Adapter” on page 18 Installing the Low-Profile Adapter The following instructions describe the basic tasks required to install the adapter.
5. Holding the adapter by the edges, align the adapter edge connector with the PCI-E slot. Slide the adapter face plate into the small slot at the end of the PCI-E opening. 6. Applying even pressure at both corners of the adapter, push the PCI-E adapter until it is firmly seated in the slot. Caution – Do not use excessive force when installing the adapter into the PCI-E slot. You might damage the adapter’s PCI-E connector.
2. List the network devices on your system Use the show-nets command to list the system devices. You should see the full path name of the network devices, similar to the following example. In this example the Sun PCI-Express Dual Gigabit Ethernet devices are shown in bold italics: a) and b) are the Sun PCI-Express Dual Gigabit Ethernet MMF device and e) and f) are the Sun PCI-Express Dual Gigabit Ethernet UTP device. The onboard UTP ports are c), d), g), and h).
b. Then use the .properties command to make sure that the device is connected to the network. Your output will be similar to the following example: ok cd /pci@7c0/pci@0/pci@8/network@0,1 ok .properties ok device-end assigned-addresses 82060110 00000000 00360000 00000000 00020000 82060114 00000000 00380000 00000000 00020000 81060118 00000000 00000020 00000000 00000020 82060130 00000000 003a0000 00000000 00020000 phy-type pcs board-model 501-7290 version Sun PCI-E 1G Ethernet MMF Adapter FCode 1.
The phy-type value is assigned as follows: Media type phy-type Fiber pcs Copper mif Note – If you are going to set the local-mac-address property, note the local-mac-address of your device at this time. See “Setting the local-macaddress Property” on page 17 for more information. Setting the local-mac-address Property Note – Setting the local-mac-address property is required only if you will be booting from the network.
Rebooting the System After verifying the adapter installation, use the boot -r command to perform a reconfiguration boot on your system. ok boot -r The reconfiguration boot attaches the driver to the adapter. You can now configure the driver parameters for your Sun PCI-Express Dual Gigabit Ethernet adapter. Installing the ExpressModule Adapter The following instructions describe the basic tasks required to install the adapter.
3. Press the Attention button. The power LED should blink about 10 times then remain a steady green light. ▼ To Verify the ExpressModule Installation 1. Use the cfgadm command to verify the ExpressModule installation: # cfgadm If the ExpressModule is properly installed and connected, you should see output similar to the following: Ap_Id pcie5 Type Receptacle Occupant Condition etherne/hp connected configured ok 2. Use the dladm show-dev command to verify that the link is up.
20 Sun PCI-Express Dual Gigabit Ethernet MMF/UTP Adapter Installation and User’s Guide • June 2006
CHAPTER 3 Configuring ipge and e1000 Driver Parameters The ipge(1M) device driver controls the Sun PCI-Express Dual Gigabit Ethernet interfaces for Solaris SPARC systems. You can manually set the ipge device driver parameters to customize each device in your system. The e1000 device driver controls the Sun PCI-Express Dual Gigabit Ethernet interfaces for Linux (RedHat and SUSE) systems. You can manually set the e1000 device driver parameters to customize each device in your system.
■ ■ ■ 100 Mbit/sec, half-duplex 10 Mbit/sec, full-duplex 10 Mbit/sec, half-duplex The Sun PCI-Express Dual Gigabit Ethernet adapter performs autonegotiation with the remote end of the link (the link partner) to select a common mode of operation. The Sun PCI-Express Dual Gigabit Ethernet ada[ter also supports a non-autonegotiated mode of operation. You can set the speed and mode using the ndd utility, or, to make sure the changes persist after a system reboot, you can create a ipge.conf file.
▼ To Specify Device Instances for the ndd Utility Before you use the ndd utility to get or set a parameter for a ipge device, you must specify the device instance for the utility. 1. Check the /etc/path_to_inst file to identify the instance associated with a particular device.
In noninteractive mode, you invoke the utility to execute a specific command. Once the command is executed, you exit the utility. In interactive mode, you can use the utility to get or set more than one parameter value. Refer to the ndd(1M) man page for more information. ▼ To Use the ndd Utility in Noninteractive Mode This section describes how to modify and display parameter values. 1. To modify a parameter value, use the -set option.
2. To list all the parameters supported by the ipge driver, type ?. See TABLE 3-4 through TABLE 3-1 for parameter descriptions.
1. Set the following driver parameters to the values that are described in the documentation that shipped with your link partner (for example, a switch): ■ ■ ■ ■ ■ ■ ■ adv-1000fdx-cap adv-100fdx-cap adv-100hdx-cap adv-10fdx-cap adv-10hdx-cap adv-asmpause-cap adv-pause-cap See TABLE 3-5 for the descriptions and possible values of these parameters. Note – According to IEEE 802.3 specifications, when using 1000 Mbit/sec speed over copper media, autonegotiation is not optional.
▼ To Set Driver Parameters Using an ipge.conf File 1. Obtain the hardware path names for the ipge devices in the device tree. a. Check the /etc/driver_aliases file to identify the name associated with a particular device: # grep ipge /etc/driver_aliases ipge "pciex8086,105e" ipge "pciex8086,105f" ipge "pci8086,105e" ipge "pci8086,105f" b. Locate the path names and the associated instance numbers in the /etc/path_to_inst file.
■ unit-address = "1" 2. Set the parameters for the ipge devices in the /kernel/drv/ipge.conf file. In the following example, the adv_autoneg_cap and adv_1000fdx_cap parameters are set for all Sun PCI-Express Dual Gigabit Ethernet devices. See the driver.conf(4) man page for more information. adv-autoneg-cap=0 adv-1000fdx-cap=0; In the following example, the adv-autoneg-cap and adv-1000fdx-cap parameters are set for a single instance of the ipge device.
TABLE 3-1 Read-Only Link Partner Capabilities (Continued) Parameter Description lp_cap_100hdx 0 = No 100 Mbit/sec half-duplex transmission 1 = 1000 Mbit/sec half-duplex lp_cap_10fdx 0 = No 10 Mbit/sec full-duplex transmission 1 = 10 Mbit/sec full-duplex lp_cap_10hdx 0 = No 10 Mbit/sec half-duplex transmission 1 = 10 Mbit/sec half-duplex lp_cap_asm_pause 0 = Not asymmetric pause capable 1 = Asymmetric pause towards link partner capability lp_cap_pause 0 = Not symmetric pause capable 1 = Symmetri
Reporting Link Partner Capabilities ▼ To Discover Link Partner Capabilities ● Use the kstat command to discover link partner capabilities. # kstat ipge:0 | grep lp_ lp_cap_1000fdx lp_cap_1000hdx lp_cap_100T4 lp_cap_100fdx lp_cap_100hdx lp_cap_10fdx lp_cap_10hdx lp_cap_asmpause lp_cap_autoneg lp_cap_pause ▼ 1 1 0 0 0 0 0 0 1 0 To Discover Link Settings ● Use the kstat command to discover link settings.
▼ To Check Layer 2 Configuration ● View the maximum transmission unit (MTU) configuration of a ipge instance at any time by using the kstat command. The kstat mac_mtu variable represents the complete size of the Ethernet frame, which includes the Ethernet header, maximum payload, and crc. This value is consistent with the definition of MTU presented by switch vendors. ● Use the following command to get the information.
Sun PCI-Express Dual Gigabit Ethernet Driver Operating Statistics The following tables describe various statistics presented by the kstat command. TABLE 3-2 describes the read-only Media Independent Interface (MII) capabilities. These parameters define the capabilities of the hardware. The Gigabit Media Independent Interface (GMII) supports all of the following capabilities.
TABLE 3-2 Read-Only ipge device Capabilities (Continued) Parameter Description (Local interface Capabilities) cap_10hdx Local interface half-duplex capability 0 = Not 10 Mbit/sec half-duplex capable 1 = 10 Mbit/sec half-duplex capable cap_asm_pause Local interface flow control capability 0 = Not asymmetric pause capable 1 = Asymmetric pause (from the local device) capable cap_pause Local interface flow control capability 0 = Not Symmetric pause capable 1 = Symmetric pause capable kstat Statistics
TABLE 3-3 Transmit and Receive Parameters (Continued) Parameter Description tx_max_pend Maximum number of transmits pending on any of the four queues. rx_hdr_pkts Number of packets received that were less than 256 bytes. rx_mtu_pkts Number of packets received that were greater than 256 bytes and less than 1514 bytes. rx_split_pkts Number of packets that were split across two pages. rx_no_comp_wb Number of times the hardware could not post completion entries for received data.
TABLE 3-4 describes the parameters and settings for the ipge device driver.
Operational Mode Parameters The parameters in TABLE 3-5 determine the transmit and receive speed and duplexing capability. TABLE 3-5 also describes the operational mode parameters and their default values.
If all these parameters are set to 1, autonegotiation uses the highest speed possible. If all these parameters are set to 0, you receive the following error message: NOTICE: Last setting will leave ipge0 with no link capabilities. WARNING: ipge0: Restoring previous setting. Flow Control Parameters The ipge device sources (transmits) and terminates (receives) pause frames conforming to the IEEE 802.3x Frame Based Link Level Flow Control Protocol.
data can be communicated. Two physical layer parameters control whether your side is the master or the slave, or whether mastership is negotiated with the link partner. TABLE 3-7 Forced Mode Parameters Parameter Description master-cfg-enable Determines whether or not during the autonegotiation process the link clock mastership is setup automatically.
You can add the additional delay by setting the ipg0 parameter from 0 to 255, which is the media byte time delay. TABLE 3-8 defines the enable_ipg0 and ipg0 parameters.
Interrupt Parameters TABLE 3-10 describes the receive interrupt blanking values. TABLE 3-10 RX Blanking Register for Alias Read Field Name Values Description rx_intr_pkts 0 to 511 Interrupt after this number of packets has arrived since the last packet was serviced. A value of zero indicates no packet blanking. (Default=3) rx_intr_time 0 to 524287 Interrupt after 4.5 US ticks have elapsed since the last packet was serviced. A value of zero indicates no time blanking.
▼ To Configure Jumbo Frames Using ndd 1. Shut down and unplumb the interface. 2. Set the instance number: % ndd -set /dev/ipge instance 0 In this example, the instance number set is 0. 3. Set the instance to accept Jumbo Frames: % ndd -set /dev/ipge accept-jumbo 1 4. Plumb the interface up: % ifconfig ipge0 plumb xx.xx.xx.xx up where xx.xx.xx.xx is the IP address of the interface. ▼ To Configure Jumbo Frames in a Linux Environment 1. Ensure that the e1000 software is installed. # modprobe e1000 2.
42 Sun PCI-Express Dual Gigabit Ethernet MMF/UTP Adapter Installation and User’s Guide • June 2006
CHAPTER 4 Configuring e1000g Driver Parameters The e1000g device driver controls the Sun PCI-Express Dual Gigabit Ethernet interfaces for Solaris x86 systems. You can manually set the e1000g device driver parameters to customize each device in your system. This chapter lists the available device driver parameters and describes how you can set these parameters.
The Sun PCI-Express Dual Gigabit Ethernet ExpressModule performs autonegotiation with the remote end of the link (the link partner) to select a common mode of operation. The Sun PCI-Express Dual Gigabit Ethernet ExpressModule also supports a nonautonegotiated mode of operation. You can set the speed and mode using the ndd utility, or, to make sure the changes persist after a system reboot, you can create a e1000g.conf file. See “To Set Driver Parameters Using the e1000g.
# NumTxDescriptors = 256; # It can have Minimum 80 or Maximum 256 descriptors. # If it is set to 256 then on Solaris 7.0 you may get # into problems while trying to load more than 1 nic as # it will demand lots of memory... NumRxDescriptors = 256; # It can have Minimum 80 or Maximum 256 descriptors. # If it is set to 256 then on Solaris 7.0 you may get # into problems while trying to load more than 1 nic as # it will demand lots of memory...
# 3 will set the 100 Mbps speed and half Duplex mode. # 4 will set the 100 Mbps speed and Full Duplex mode. # 7 will let adapter autonegotiate. AutoNegAdvertised=0; # This parameter determines the speed/duplex options that will be # advertised during auto-negotiation. This is a bitmap with the # following settings.
3. Save the e1000g.conf file. 4. Reboot for the change to take effect: # reboot Setting Parameters Using the ndd Utility In addition to the e1000g.conf file, you can also use the ndd(1M) command to configure the e1000g driver. # ndd -get /dev/e1000g0 ? Using ndd(1M), you can set the link speed/duplex using the advertised capability parameters supported by the e1000g device. Each parameter contains a boolean value that determines if the device advertises that mode of operation.
Note – Forced 1000Mbps full-duplex is not supported.
Jumbo Rx Frame 8K Jumbo Rx Frame 16K Jumbo Tx Frame 4K Jumbo Tx Frame 8K Jumbo Tx Frame 16K link_up Pkts_Recvd_( 64b) Pkts_Recvd_( 65- 127b) Pkts_Recvd_( 127- 255b) Pkts_Recvd_( 256- 511b) Pkts_Recvd_( 511-1023b) Pkts_Recvd_(1024-1522b) Pkts_Xmitd_( 64b) Pkts_Xmitd_( 65- 127b) Pkts_Xmitd_( 128- 255b) Pkts_Xmitd_( 255- 511b) Pkts_Xmitd_( 512-1023b) Pkts_Xmitd_(1024-1522b) Recv_Frag Recv_Jabber Recv_Length_Errors Recv_Missed_Packets Recv_Oversize Recv_Symbol_Errors Recv_Undersize Recv_Unsupport_FC_Pkts Reset
Tx Desc Insufficient Tx Desc Recycle Tx Desc Recycle Intr Tx Desc Recycle Retry Tx Desc Recycled None Tx Exceed Max Frags Tx No Buffer Tx No Desc Tx Pkt Over Size Tx Pkt Under Size Tx Reschedule Tx Send Bind Tx Send Copy Tx Send Failure Tx Stall Watchdog Xmit_TCP_Seg_Contexts Xmit_TCP_Seg_Contexts_Fail Xmit_with_No_CRS XOFFs_Recvd XOFFs_Xmitd XONs_Recvd XONs_Xmitd 0 0 43575 0 26 6306 0 0 0 1452 0 10 229694 0 0 0 0 0 0 0 0 0 Sun PCI-Express Dual Gigabit Ethernet e1000g Driver Parameters You can manually co
TABLE 4-2 e1000g Driver Parameter, Status, and Descriptions (Continued) Parameter Status Description TbiCompatibilityEnable Read and write Operational mode parameter FlowControl Read and write Flow control parameter SetMasterSlave Read and write Gigabit link clock mastership controls NumRxDescriptors Read and write Receive performance NumTxDescriptors Read and write Transmit performance NumRxFreeList Read and write Receive performance MaxNumReceivePackets Read and write Receive perf
Configurable Operational Mode Parameters The parameters in TABLE 4-3 determine the transmit and receive speed and duplexing capability. TABLE 4-3 also describes the operational mode parameters and their default values TABLE 4-3 52 Operational Mode Parameters Parameter Description AutoNegAdvertised A bitmap for the speeds advertised during autonegotiation. The adapter only autonegotiates to a speed that is advertised.
TABLE 4-3 Operational Mode Parameters (Continued) Parameter Description MaxFrameSize Upper limit on the maximum MTU size the driver allows. All Intel gigabit adapters (except the 82542-based Intel PRO/1000 adapter) allow the configuration of jumbo frames. The maximum MTU accepted by the MAC is 16128. Use ifconfig(1M) to configure jumbo frames. Use ifconfig with the adapter instance and the MTU argument (ifconfig e1000g0 mtu 16128) configures adapter e1000g0 for the maximum allowable jumbo frame size.
Nonconfigurable Operational Mode Parameters By default, the following configuration options are not displayed in the e1000g.conf file. Although they are actually configurable, you should not change these options: TABLE 4-4 Nonconfigurable Operational Mode Parameters Parameter Description NumRxDescriptors Number of available receive descriptors. Multiple receive descriptors increase receive performance, but decrease available memory. 80-4096 Allowed values. 1024 = Default.
Refer to the documentation that came with your switch for exact commands to configure Jumbo Frames support. ▼ To Configure Jumbo Frames in a Solaris x86 Environment 1. Edit the /kernel/drv/e1000g.conf file: # cd /kernel/drv/e1000g.conf 2. Modify the MaxFrameSize value: MaxFrameSize=0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0; ^ ^ ^ | | | | | e1000g2 | e1000g1 e1000g0 # 0 is for normal ethernet frames. # 1 is for upto 4k size frames. # 2 is for upto 8k size frames. # 3 is for upto 16k size frames.
Note – The MTU size cannot be set to higher than max limit in e1000g.conf. For example: if MaxFrameSize=0,0,2... then max MTU of e1000g2 will be 8k, First plumb of e1000g2 the MTU will be set to 8168 automatically, you can change it to 1500 but not 9000.
CHAPTER 5 Configuring VLANs This chapter explains virtual local area networks (VLANs) in detail and provides configuration instructions and examples. It contains the following sections: ■ ■ “Overview of VLANs” on page 57 “Configuring VLANs” on page 59 With multiple VLANs on an adapter, a server with a single adapter can have a logical presence on multiple IP subnets. By default, 128 VLANs can be defined for each VLAN-aware adapter on your server.
Although VLANs are commonly used to create individual broadcast domains and/or separate IP subnets, it can be useful for a server to have a presence on more than one VLAN simultaneously. Several Sun products support multiple VLANs on a per port or per interface basis, allowing very flexible network configurations. FIGURE 5-1 shows an example network that uses VLANs.
■ VLAN 2 includes the Main Server, Clients 1 and 2 by means of a shared media segment, and Client 5. This is a software development group. ■ VLAN 3 includes the Main Server, the Accounting Server, and Client 4. This is an accounting group. The Main Server is a high-use server that needs to be accessed from all VLANs and IP subnets. The server has a Sun 10-Gigabit Ethernet adapter installed. All three IP subnets are accessed by means of the single physical adapter interface.
IP subnets when setting up a VLAN network interface. This means that each VID assigned to a VLAN interface of a physical network interface will belong to different subnets. Tagging an Ethernet frame requires the addition of a tag header to the frame. The header is inserted immediately following the destination MAC address and the source MAC address. The tag header consists of two bytes of Ethernet Tag Protocol identifier (TPID, 0x8100) and two bytes of tag control information (TCI).
2. Use the ifconfig(1M) to configure a VLAN virtual device, for example: # ifconfig ipge123000 plumb up # ifconfig ipge4000 plumb up The output of ifconfig -a on a system having VLAN devices ipge123000 and ipge224000: # ifconfig -a ipge4000: flags=201000843 mtu 1500 index 5 inet 0.0.0.0 netmask ff000000 ether 0:3:ba:d8:d3:a6 ipge123000: flags=201000843 mtu 1500 index 4 inet 0.0.0.0 netmask ff000000 ether 0:3:ba:d8:d3:a6 3.
62 Sun PCI-Express Dual Gigabit Ethernet MMF/UTP Adapter Installation and User’s Guide • June 2006
APPENDIX A Specifications This appendix lists the specifications for the Sun PCI-Express Dual Gigabit Ethernet adapter.
FIGURE A-2 shows the connector for the version of the Sun PCI-Express Dual Gigabit Ethernet UTP Low-Profile adapter. FIGURE A-2 Sun PCI-Express Dual Gigabit Ethernet UTP Low-Profile Adapter Connector Table A-2 lists the characteristics of the Cat-5 connector used by the Sun PCI-Express Dual Gigabit Ethernet UTP Low-Profile adapter.
TABLE A-4 lists the characteristics of the connector used by the Sun PCI-Express Dual Gigabit Ethernet UTP adapter. TABLE A-4 ExpressModule Connector Link Characteristics Description Distance Operating range Up to 100 meters Low-Profile Performance Specifications TABLE A-5 Low-Profile Performance Specifications Feature Specification Bus type PCI-Express 1.
Low-Profile Power Requirements TABLE A-7 Low-Profile Power Requirements Specification Measurement Typical UTP power consumption 4.95 W (3.3 V @ 1.5 A) Typical MMF power consumption 3.3v (1.0A @ 3.3v) ExpressModule Performance Specifications TABLE A-8 66 ExpressModule Performance Specifications Feature Specification Bus type PCI ExpressModule 1.
ExpressModule Physical Characteristics TABLE A-9 ExpressModule Physical Characteristics Dimension Measurement Length 6.61 inches (168 mm) Width 4.25 inches (108 mm) ExpressModule Power Requirements TABLE A-10 ExpressModule Power Requirements Specification Measurement Typical UTP power consumption 4.4 W (12V @ 0.36A) Typical MMF power consumption 3.3 W (12V @ 0.
68 TABLE A-11 ExpressModule Environmental Requirements Specification Measurement Altitude Operating: 0 to 10,000 feet Nonoperating: 0 to 12,000 feet Vibration (Random) Operating: 0.0001 G/Hz, 5 - 150 Hz, -12 db/octave slope 150 - 500 Hz Nonoperating: 0.
APPENDIX B Diagnostic Software This appendix provides an overview of the SunVTS™ diagnostic application and instructions for updating the SunVTS software to recognize the adapter.
http://www.sun.com/documentaiton Select the document for the Solaris release on your system.
▼ To Update SunVTS to Recognize the ExpressModule Adapter 1. Connect a loopback cable. 2. Ensure that the SunVTS software and the e1000g driver are installed on your system. 3. Add the following lines to the /opt/SUNWvts/lib/conf/netlbtest.conf and /opt/SUNWvts/lib/conf/nettest.conf files: e1000g e1000g 1kbaseT Using the SunVTS netlbtest You must have the Ethernet card and the device driver installed, a loopback connector in place, and Intervention mode enabled before running netlbtest.
Using the OpenBoot PROM FCode SelfTest The Sun PCI-Express Dual Gigabit Ethernet Low-Profile adapter self-test is a suite of tests that reside in the adapter’s FCode PROM. You can only invoke the FCode self-test diagnostics using the OpenBoot PROM test or test-all commands. In order to access the OpenBoot PROM, you must shut down and halt your system to display the ok prompt. You can use the adapter’s self-test any time you want to determine the status of the hardware.
4. Set the diag-switch? parameter to true in order to see the diagnostic power-on self-test (POST) messages. ok setenv diag-switch? true 5. Reset the system to activate these parameter changes. ok reset-all 6. Use the show-nets command to display the list of network devices on the system. Among the list of devices, you should see the interfaces specific to the Sun PCIExpress Dual Gigabit Ethernet Low-Profile adapter you want to test, as shown in the following example.
7. Use the test command and the device paths found in Step 6 to test the adapter when you use the FCode self-test. The structure of the test command line includes the following device parameters: ok test device-path:speed=s,duplex=d,link-clock=c,promiscuous, where: s = 1000, 100, 10, auto d = half, full, auto c = master, slave, auto Note – The speed, duplex, and link-clock parameters are optional tests.
Note – To test all of the interfaces of the adapter, you need to execute the test command separately for each SUNW,ipge interface. If all of the tests pass, you will see these messages: ok test /pci@780/pci@0/pci@8/network@0,1 Testing /pci@780/pci@0/pci@8/network@0,1 Interrupt registers test PASSED. Receive registers test PASSED. Transmit registers test PASSED. Wakeup registers test PASSED. PCI-E registers test PASSED. Diagnostic registers test PASSED.
9. At the ok prompt, reset the auto-boot? configuration variable to true. ok setenv auto-boot? true 10. Reset and reboot the system. ok reset-all Refer to the system’s documentation for the correct procedures for bringing up the system.
APPENDIX C Installing the Sun PCI-Express Dual Gigabit Ethernet Device Driver on Linux Platforms This appendix explains how to install the Sun PCI-Express Dual Gigabit Ethernet device driver in a Linux environment.
2. Build the man pages (optional): For RedHat, use the following command: # rpmbuild --rebuild sun-pci-e-dual-gigabit-kernel-6.1.5.src.rpm 3. Change to the rpm directory: For RedHat, use the following command: # cd /usr/src/redhat/RPMS/arch 4. Install the Sun PCI-Express Dual Gigabit Ethernet rpms, using the same command for both RedHat and Suse: # rpm -ivh sun-pci-e-dual-gigabit-kernel-6.1.5.rpm 5. Use the depmod command to register the Sun 10-Gigabit Ethernet module: # depmod 6.
7. Verify that the driver is loaded. In the following example, the e1000 driver is shown in bold italic. On your system the driver will be indistinguishable from the other modules.
8. Run the dmesg command to see which devices the e1000 driver was mapped to: # dmesg divert: allocating divert_blk for eth3 e1000: eth3: e1000_probe: Intel(R) PRO/1000 Network Connection e1000: eth2: e1000_watchdog: NIC Link is Up 1000 Mbps Full Duplex e1000: eth3: e1000_watchdog: NIC Link is Up 1000 Mbps Full Duplex 9. Add the e1000 interfaces to the /etc/modules.conf file for 2.4 based kernels and to /etc/modprobe.conf file for 2.6 based kernels. alias eth2 e1000 alias eth3 e1000 10.
1. Create a performance tuning script (for example, e1000_perf.sh), and edit this file to add the interface or device ID of Sun PCI-Express Dual Gigabit Ethernet Low-Profile adapter. #!/bin/bash echo "configuring network performance" # set mmrbc to 4k reads, modify only Sun PCI-E Dual Gigabit device IDs # set the MTU (max transmission unit) - it requires your switch and # clients to change too and should support the value you provide here. # Also set the txqueuelen on your SSun PCI-E Dual Gigabit adapter.
2. Create the conf file (for example, sysctl_e1000.conf) that will be called by the sysctl utility. ### IPV4 specific settings # turns TCP timestamp support off, default 1, reduces CPU use net.ipv4.tcp_timestamps = 0 # turn SACK support off, default on systems with a VERY fast bus -> # memory interface this is the big gainer net.ipv4.tcp_sack = 0 # sets min/default/max TCP read buffer, default 4096 87380 174760 net.ipv4.
▼ To Set e1000 Parameters in a Linux Environment 1. Remove the Sun PCI-Express Dual Gigabit Ethernet device driver, if it is already loaded. # rmmod e1000 2. Load the Sun PCI-Express Dual Gigabit Ethernet device driver: # modprobe e1000 option=VAL1, VAL2, . . . Or you can use the insmod command: # insmod e1000 option=VAL1, VAL2, . . . where VAL1 applies to the first e1000 interface and VAL2 to the next interface and so on.
TABLE C-1 lists the tunable e1000 driver parameters for Linux operating systems, and describes their function. TABLE C-1 84 Tunable e1000 Driver Parameters for Linux Operating Systems Keyword Description FlowControl Valid Range: 0-3 (0=none, 1=Rx only, 2=Tx only, 3=Rx&Tx) Default: Read from the EEPROM If EEPROM is not detected, default is 3. This parameter controls the automatic generation (Tx) and response (Rx) to Ethernet PAUSE frames.
▼ To Configure VLANs in a Linux Environment 1. Ensure that the e1000 module is loaded: # modprobe e1000 2. Plumb the Sun PCI-Express Dual Gigabit Ethernet interface: # ifconfig eth2 xxx.xxx.xx.xxx up where xxx.xxx.xx.xxx = the IP address of the interface. 3. Insert the VLAN module: # /sbin/modprobe 8021q 4. Add the VLAN instance (VID): # /sbin/vconfig add eth2 5 5. Configure the e1000 VLAN (eth2 in this example): # ifconfig eth2.5 xxx.xxx.xx.xxx up where xxx.xxx.xx.
▼ To Configure Bonding for Multiple e1000 Interfaces 1. Modify the /etc/modules.conf file for 2.4 kernels or the /etc/modprobe.conf file for 2.6 kernels file by adding these lines: alias bond0 bonding options bonding max_bonds=2 mode=4 miimon=1000 where: ■ ■ ■ ■ bond0 is the bonding device. max_bonds is the number of bond interfaces to be created. mode specifies the bonding policies. miimon is the frequency in milliseconds that MII link monitoring will occur.
Index Symbols F .
ok prompt, 72 test command, 74 operational mode parameters, 36 P parameter values how to modify and display, 24 parameters and settings, 35 R receive interrupt blanking values, 35, 40 S self-test diagnostics, 72 setting e1000g driver parameters using ndd using e1000g.conf, 44 setting e1000g driver parameters, 43 setting ipge driver parameters using ndd using ipge.
