Sun Microsystems Network Card Ethernet PCI X Adapter User Manual

Sun 10-Gigabit Ethernet PCI-X  
Adapter Installation and User’s  
Guide  
Sun Microsystems, Inc.  
Part No. 819-0938-12  
December 2005, Revision A  
Submit comments about this document at: http://www.sun.com/hwdocs/feedback  
 
Preface xiii  
1. Product Overview  
1
Features  
3
2. Installing the Adapter  
5
5
7
Using the Installation Script 11  
Configuring the Network Host Files 15  
3. Configuring Driver Parameters 19  
10-Gigabit Ethernet Device Driver Parameters 19  
iii  
 
To Configure Jumbo Frames in a Linux Environment 23  
Setting ixgeDriver Parameters 23  
To Check Link Partner Settings 32  
4. Configuring VLANs 37  
A. Specifications 43  
Performance Specifications 43  
Physical Characteristics 44  
Power Requirements 44  
iv Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
Updating SunVTS to Recognize the Adapter 46  
To Use the netlbtest 47  
Setting Up the Driver in a Linux Platform 53  
Setting Driver Parameters in a Linux Environment 56  
To Set ixgeParameters in a Linux Environment 57  
To Configure VLANs in a Linux Environment 59  
To Configure Bonding for Multiple ixgeInterfaces 60  
Index 61  
Contents  
v
 
vi Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
TABLE 1-1  
TABLE 3-1  
TABLE 3-2  
TABLE 3-3  
TABLE 3-4  
TABLE 3-5  
TABLE 3-6  
TABLE A-1  
TABLE A-2  
TABLE A-3  
TABLE B-1  
TABLE C-1  
TABLE D-1  
accept-jumbo Parameters 22  
2
Read-Only ixgeDevice Capabilities 29  
Power Requirements 44  
SunVTS Documentation 46  
Files and Directories on the CD-ROM 50  
Tunable ixgeDriver Parameters for Linux Operating Systems 58  
vii  
 
viii  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
Figures  
FIGURE 1-1  
FIGURE 1-2  
FIGURE 4-1  
FIGURE 4-2  
Sun 10-Gigabit Ethernet PCI-X Adapter with Optical Transceiver Installed  
2
Sun 10-Gigabit Ethernet PCI-X Adapter Fiber Optic Channels  
3
Example of Servers Supporting Multiple VLANs With Tagging Adapters 38  
Ethernet Tag Header Format 40  
ix  
 
x
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
Declaration of Conformity  
Compliance Model Number:  
Product Family Name:  
Kirkwood  
Sun 10-GB Ethernet PCIX (X5558A  
EMC  
USA—FCC Class A  
This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions:  
1. This equipment may not cause harmful interference.  
2. This equipment must accept any interference that may cause undesired operation.  
European Union  
This equipment complies with the following requirements of the EMC Directive 89/336/EEC:  
As Telecommunication Network Equipment (TNE) in Both Telecom Centers and Other Than Telecom Centers per (as applicable):  
EN300-386 V.1.3.1 (09-2001) Required Limits:  
EN55022/CISPR22  
EN61000-3-2  
EN61000-3-3  
EN61000-4-2  
EN61000-4-3  
EN61000-4-4  
EN61000-4-5  
EN61000-4-6  
EN61000-4-11  
Class A  
Pass  
Pass  
6 kV (Direct), 8 kV (Air)  
3 V/m 80-1000MHz, 10 V/m 800-960 MHz, and 1400-2000 MHz  
1 kV AC and DC Power Lines, 0.5 kV Signal Lines  
2 kV AC Line-Gnd, 1 kV AC Line-Line and Outdoor Signal Lines, 0.5 kV Indoor signal Lines > 10m  
3 V  
Pass  
As Information Technology Equipment (ITE) Class A per (as applicable):  
EN55022:1998/CISPR22:1997  
EN55024:1998 Required Limits:  
EN61000-4-2  
Class A  
4 kV (Direct), 8 kV (Air)  
EN61000-4-3  
3 V/m  
EN61000-4-4  
1 kV AC Power Lines, 0.5 kV Signal and DC Power Lines  
EN61000-4-5  
1 kV AC Line-Line and Outdoor Signal Lines, 2 kV AC Line-Gnd, 0.5 kV DC Power Lines  
EN61000-4-6  
3 V  
EN61000-4-8  
EN61000-4-11  
EN61000-3-2:1995 + A1, A2, A14  
EN61000-3-3:1995  
1 A/m  
Pass  
Pass  
Pass  
Safety: This equipment complies with the following requirements of the Low Voltage Directive 73/23/EEC:  
EC Type Examination Certificates:  
EN60950:2000, 3rd Edition  
IEC 60950:2000, 3rd Edition  
TÜV Rheinland Certificate No. xxxxxxxxxxxx  
CB Scheme Certificate No. xxxxxxxxxxxx  
Evaluated to all CB Countries  
UL 60950, 3rd Edition, CSA C22.2 No. 60950-00  
UL 60950, 3rd Edition, CSA C22.2 No. 950-00  
FDA DHHS Accession Number (Monitors Only)  
File:  
File:  
Vol.  
Vol.  
Sec.  
Sec.  
Supplementary Information: This product was tested and complies with all the requirements for the CE Mark.  
/S/  
/S/  
Dennis P. Symanski  
DATE  
Pamela J. Dullaghan  
DATE  
Manager, Compliance Engineering  
Sun Microsystems, Inc.  
4150 Network Circle, MPK15-102  
Santa Clara, CA 95054 U.S.A.  
Tel: 650-786-3255  
Quality Program Manager  
Sun Microsystems Scotland, Limited  
Springfield, Linlithgow  
West Lothian, EH49 7LR  
Scotland, United Kingdom  
Tel: +44 1 506 672 395  
Fax: 650-786-3723  
Fax: +44 1 506 670 011  
xi  
 
xii  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
Preface  
The Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide provides  
installation instructions for the Sun 10-Gigabit Ethernet PCI-X adapter. This  
document also describes how to configure the driver software.  
These instructions are designed for enterprise system administrators with experience  
installing network hardware and software.  
How This Book Is Organized  
Chapter 1 provides a description of the adapter, including hardware and software.  
Chapter 2 describes how to install the adapter in your system, verify that it is  
correctly installed, and install the driver software using the automated script.  
Chapter 3 describes how to configure the driver parameters used by the Sun 10-  
Chapter 4 explains VLANs in detail, and provides configuration instructions and  
Appendix A provides specifications for the Sun 10-Gigabit Ethernet PCI-Xadapter.  
Appendix B provides an overview of the SunVTS diagnostic application and  
instructions for updating the SunVTS software to recognize the adapter.  
Appendix C describes how to install the driver software manually.  
Appendix D explains how to install and configure the Sun 10-Gigabit Ethernet PCI-  
X device driver in a Linux environment.  
xiii  
 
 
Using UNIX Commands  
This document might not contain information on basic UNIX commands and  
procedures such as shutting down the system, booting the system, and configuring  
devices. Refer to the following for this information:  
®
Software documentation that you received with your system  
Solaris™ Operating System documentation, which is at:  
Shell Prompts  
Shell  
Prompt  
C shell  
machine-name%  
C shell superuser  
machine-name#  
Bourne shell and Korn shell  
Bourne shell and Korn shell superuser  
$
#
xiv Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
Typographic Conventions  
*
Typeface  
Meaning  
Examples  
AaBbCc123  
The names of commands, files,  
and directories; on-screen  
computer output  
Edit your.loginfile.  
Use ls-ato list all files.  
% You have mail.  
What you type, when contrasted % su  
with on-screen computer output  
AaBbCc123  
Password:  
Book titles, new words or terms, Read Chapter 6 in the User’s Guide.  
AaBbCc123  
words to be emphasized.  
Replace command-line variables  
with real names or values.  
These are called class options.  
You must be superuser to do this.  
To delete a file, type rmfilename.  
*
The settings on your browser might differ from these settings.  
Accessing Sun Documentation  
You can view, print, or purchase a broad selection of Sun documentation, including  
localized versions, at:  
Third-Party Web Sites  
Sun is not responsible for the availability of third-party web sites mentioned in this  
document. Sun does not endorse and is not responsible or liable for any content,  
advertising, products, or other materials that are available on or through such sites  
or resources. Sun will not be responsible or liable for any actual or alleged damage  
or loss caused by or in connection with the use of or reliance on any such content,  
goods, or services that are available on or through such sites or resources.  
Preface  
xv  
 
Contacting Sun Technical Support  
If you have technical questions about this product that are not answered in this  
document, go to:  
Sun Welcomes Your Comments  
Sun is interested in improving its documentation and welcomes your comments and  
suggestions. You can submit your comments by going to:  
Please include the title and part number of your document with your feedback:  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide, part number 8xx-  
xxxx-xx  
xvi Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
CHAPTER  
1
This chapter contains an overview of the Sun 10-Gigabit Ethernet PCI-X adapter,  
including:  
“Product Description” on page 1  
“Hardware and Software Requirements” on page 2  
“Features” on page 3  
The Sun 10-Gigabit Ethernet PCI-X adapter is a low profile 133 MHz 10 gigabit  
Ethernet card utilizing the Intel 82597EX PCI-X MAC controller with XFP-based 10-  
gigabit Ethernet optics.  
FIGURE 1-1 shows the adapter with the optical transceiver inserted.  
Note – The adapter must be inserted into the system first. Then insert the optical  
transceiver into the adapter.  
1
 
     
FIGURE 1-1 Sun 10-Gigabit Ethernet PCI-X Adapter with Optical Transceiver Installed  
Hardware and Software Requirements  
Before installing the adapter, make sure your system meets the required hardware  
and software. TABLE 1-1 lists the supported hardware and software for Sun SPARC®  
systems.  
TABLE 1-1  
Hardware and Software Requirements for Sun SPARC Servers  
Requirements  
Hardware or Software  
Hardware  
Sun Fire™ V440, 490, 880, V890, T2000  
Sun Fire V40z, X4200  
Operating System  
Solaris 9 9/04, and 10 SPARC Operating System  
RedHat Enterprise Linux 3.0 and 4.0  
SuSe Linux Enterprise Server 9.0 SP1  
Note – The preceding information is up-to-date as of the printing of this manual.  
Visit Sun on the World Wide Web at http://www.sun.com/for the latest  
information.  
2
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
       
FIGURE 1-2 Sun 10-Gigabit Ethernet PCI-X Adapter Fiber Optic Channels  
Features  
The Sun 10-Gigabit Ethernet PCI-X adapter addresses the following requirements  
and provides additional features and benefits:  
One full-duplex 10 gigabit Ethernet interface that uses a small form factor  
pluggable (XFP) optical transceiver duplex LC fiber connector  
PCI-X -133MHz compatible and PCI-66 MHz compliant  
Uses the Intel 82597EX PCI-X MAC controller  
Uses XAUI to XFI Serdes  
Dynamic reconfiguration (DR) and redundancy/failover support  
kstatand snoopsupport  
Support for promiscuous and multicast modes  
Jumbo frames support up to 8000 bytes  
Low profile 64-bit PCI-X plug-in card  
PCI Local Bus Rev 2.3-compliant (6.6-inch x 2.536-inch short card)  
Implements PCI-X addendum to PCI Local Bus specifications, Revision 1.0A  
IPv4, IPv6, and IPMP support  
TCP, UDP, and IP hardware checksum offload  
802.1Q VLAN support  
IEEE 802.3ad link aggregation (trunking)  
NDD physical layer management configuration capability  
Chapter 1 Product Overview  
3
 
   
4
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
CHAPTER  
2
Installing the Adapter  
This chapter describes how to install the Sun 10-Gigabit Ethernet PCI-X adapter in  
chapter describes how to edit the network host files after installing the adapter on  
This chapter contains the following sections:  
“Installing the Adapter Without Dynamic Reconfiguration” on page 5  
“Installing the Adapter With Dynamic Reconfiguration” on page 11  
“Using the Installation Script” on page 11  
Verifying the Software Installation” on page 14  
“Configuring the Network Host Files” on page 15  
Note – If you are installing the Sun 10-Gigabit Ethernet PCI-X adapter in a machine  
running the Solaris x86 Operating System Dynamic Reconfiguration (DR) is not  
supported.  
Installing the Adapter Without Dynamic  
Reconfiguration  
Caution – If your are installing the Sun 10-Gigabit Ethernet PCI-X adapter into a  
machine running Solaris 10, you must install the software before you install the  
hardware. Failure to install the software before installing the hardware will allow the  
Sun 10-Gigabit Ethernet PCI-X adapter to attach to an older version of the software.  
See “Using the Installation Script” on page 11.  
5
 
         
To Install the Adapter  
The following instructions describe the basic tasks required to install the adapter.  
Refer to your system installation or service manual for detailed PCI adapter  
installation instructions.  
1. Halt and power off your system.  
2. Power off all of the peripherals connected to your system.  
3. Open the system unit.  
4. Attach the antistatic wrist strap to yourself and to the system.  
Attach the adhesive copper strip of the antistatic wrist strap to the metal casing of  
the power supply. Wrap the other end twice around your wrist, with the adhesive  
side against your skin.  
5. Holding the PCI adapter by the edges, unpack it and place it on an antistatic  
surface.  
6. Using a No. 2 Phillips screwdriver, remove the PCI filler panel from the slot in  
which you want to insert the PCI adapter.  
Save the filler panel screw for Step 9.  
7. Insert the adapter into the PCI opening.  
Holding the PCI adapter by the edges, align the adapter edge connector with a 66  
MHz PCI slot or a PCI-X slot. Slide the adapter face plate into the small slot at the  
end of the PCI opening.  
8. Applying even pressure at both corners of the adapter, push the PCI adapter until  
it is firmly seated in the slot.  
Caution – Do not use excessive force when installing the adapter into the PCI slot.  
You might damage the adapter’s PCI connector. If the adapter does not seat properly  
when you apply even pressure, remove the adapter and carefully reinstall it.  
9. Secure the adapter to the PCI slot using the screw you removed in Step 6.  
10. Close the system.  
Note – Green LEDs do not light until the correct driver is installed.  
6
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
       
To Install the Optical Transceiver  
The Sun 10-Gigabit Ethernet PCI-Xadapter requires an optical transceiver to create  
and Ethernet connection. The optical transceiver Part Number: 135-1172-01 is  
available from Sun Microsystems.  
1. Pull the white locking handle into the full horizontal position.  
You will feel the handle click into position when it is fully opened.  
2. Holding the optical transceiver by the edges, align the transceiver with the slot in  
the Sun 10-Gigabit Ethernet PCI-Xadapter and slide it into the opening.  
3. Applying even pressure at both corners of the transceiver, push the transceiver  
until it is firmly seated in the slot.  
Chapter 2 Installing the Adapter  
 
7
 
4. Push the handle closed to lock the optical transceiver in place.  
5. Detach the wrist strap.  
Caution – If you pull the locking handle down when the optical transceiver is  
installed, remove the optical transceiver entirely and reinstall it. The handle operates  
an internal lock. Pulling the handle down can disconnect the optical transceiver,  
even though it might appear to be connected.  
6. Connect the Ethernet cable.  
8
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
To Verify the Hardware Installation  
After you have installed the Sun 10-Gigabit Ethernet adapter, but before you boot  
your system, perform the following tasks to verify the installation. Refer to the your  
Solaris documentation for the detailed instructions.  
Note – Verification is not required if your system supports dynamic reconfiguration  
(DR). Verification is not supported if your system is running Solaris x86 software.  
1. Power on the system, and when the banner appears, press the Stop-A key  
sequence to interrupt the boot process and display the OpenBoot (ok) prompt.  
2. List the network devices on your system.  
ok show-devs  
The output from this command is extensive. Look for ethernet@and network@to  
see the networkdevices. In this example, the ethernet@1device is the Sun 10-  
Gigabit Ethernet adapter, shown in bold italics for ease of use.  
ok show-devs  
.............................................................  
/packages  
/pci@9,600000/pci@2  
/pci@9,600000/ethernet@1  
/pci@9,600000/pci@2/network@3  
/pci@9,600000/pci@2/network@2  
/pci@9,600000/pci@2/network@1  
/pci@9,600000/pci@2/network@0  
/pci@9,700000/usb@1,3  
................................................................  
/pci@9,600000/ethernet@1identifies the 10-gigabit Ethernet port.  
Note – If you do not see the device listed, check that the adapter is properly seated.  
If necessary, reinstall the adapter.  
3. View the device that you installed.  
Using the previous example, type:  
cd /pci@9,600000/ethernet@1  
Chapter 2 Installing the Adapter  
 
9
   
4. View the .propertiesfile for a list of device properties.  
The .propertiescommand displays the specific information about the installed  
adapter. If you are using the Sun 10-Gigabit Ethernet adapter, your output will be  
similar to the following:  
ok cd /pci@9,600000/ethernet@1  
ok .properties  
assigned-addresses  
83000810 00000000 00100000 00000000 00008000  
81000820 00000000 00000300 00000000 00000020  
00000800 00000000 00000000 00000000 00000000  
03000810 00000000 00000000 00000000 00008000  
01000820 00000000 00000000 00000000 00000020  
70 63 69 38 30 38 36 2c 31 30 34 38 2e 38 30 38  
ethernet  
reg  
compatible  
name  
66mhz-capable  
devsel-speed  
class-code  
interrupts  
latency-timer  
cache-line-size  
max-latency  
min-grant  
subsystem-id  
subsystem-vendor-id  
revision-id  
device-id  
00000001  
00020000  
00000001  
00000040  
00000010  
00000000  
000000ff  
00007036  
0000108e  
00000002  
00001048  
00008086  
vendor-id  
ok  
5. Type the following when you finish looking at the .propertiesvalues:  
ok device-end  
Rebooting the System  
After verifying the adapter installation, use the boot -rcommand to perform a  
reconfiguration boot on your system.  
ok boot -r  
10  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
 
Installing the Adapter With Dynamic  
Reconfiguration  
If you have a Sun Enterprise™ system that supports dynamic reconfiguration (DR),  
you do not have to reboot your system after installing the adapter.  
The process of adding and configuring an adapter with DR involves connecting the  
attachment point and configuring its occupant. In most cases, the cfgadm(1M)  
command can perform both steps at once.  
Note – If you have a Sun Enterprise system that supports dynamic reconfiguration  
(DR), refer to the Sun Enterprise Dynamic Reconfiguration User’s Guide and your  
system’s documentation for further information about dynamic reconfiguration. DR  
is not supported in the Solaris x86 operating system.  
Using the Installation Script  
The Sun 10-Gigabit Ethernet CD provides automated installation for the Sun 10-  
Gigabit Ethernet PCI-X driver software. In most cases, you can use the following  
procedure and execute the installation script. If you have any problems, see  
Appendix C for manual installation procedures.  
The script first checks to ensure that the software driver package has already been  
installed. If the package is installed, the script verifies the patch level and updates  
the driver with the updated patch if necessary. If the packages are not installed on  
Solaris 9 or 10 software, the installation script installs the latest prepatched  
packages. If the system does not require updating because the patch level is at or  
beyond the current installed version, the script exits with an appropriate message.  
To Install the Software Using the Installation  
Script  
1. At the system console, become superuser (root).  
2. Insert the Sun 10-Gigabit Ethernet Adapter CD into a CD-ROM drive that is  
connected to your system.  
Chapter 2 Installing the Adapter  
 
11  
           
If your system is running Sun Enterprise Volume Manager™, it should  
automatically mount the CD-ROM to the /cdrom/cdrom0directory.  
If your system is not running Sun Enterprise Volume Manager, mount the CD-  
ROM as follows:  
# mount -F hsfs -o ro /dev/dsk/c0t6d0s2 /cdrom/cdrom0  
Note – If you are installing the software from the download site, follow the online  
download instructions.  
3. Change to the directory were the installation script resides:  
# cd /media-path/  
where:  
media-path = /cdrom/cdrom0, if you are installing from the CD-ROM.  
unzipped 10-Gigabit-path/Sun_10-Gigabit_Ethernet_Driver, if you  
downloaded the driver from the Sun download center.  
4. Execute the installation script:  
# ./install  
Note – After the installation script runs, you see a summary of the software package  
or patch that was installed. You can also find a log of the installation in /var/tmp.  
The log file information is displayed when the installation completes unless the  
software meets or exceeds the required package or patch level.  
You’ll see the following output:  
CODE EXAMPLE 2-1  
Typical Install Script Output  
# ./install  
10-Gigabit Ethernet Adapter Driver for sparc Installation.  
Copyright 2004 Sun Microsystems, Inc. All rights reserved.  
Use is subject to license terms.  
12  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
CODE EXAMPLE 2-1  
Typical Install Script Output (Continued)  
*** Checking for correct version of 10-Gigabit Ethernet Driver  
Packages...  
*** Checking for correct version of VLAN Utility Driver Packages..  
*** Checking for correct version of VLAN Utility Driver Patches...  
The following optional supporting driver(s) can be used with 10-  
Gigabit Ethernet Adapter Driver:  
VLAN Utility Driver software (Installed)  
This script is about to take the following actions:  
- Install 10-Gigabit Ethernet Adapter Driver packages.  
- Install VLAN Ethernet Utility Patch: 114600-04.  
Press return to continue, or 'Q' followed by a return to quit:  
*** Installing patch 114600-04 for Solaris 9...  
Checking installed patches...  
Verifying sufficient filesystem capacity (dry run method)...  
Installing patch packages...  
Patch number 114600-04 has been successfully installed.  
See /var/sadm/patch/114600-04/log for details  
Patch packages installed:  
SUNWvld  
SUNWvldu  
SUNWvldx  
*** Installing Sun 10-Gigabit Ethernet packages...  
Copyright 2004 Sun Microsystems, Inc. All rights reserved.  
Use is subject to license terms.  
System configuration files modified but ixge driver not loaded or  
attached.  
Installation of <SUNWixged> was successful.  
Copyright 2004 Sun Microsystems, Inc. All rights reserved.  
Use is subject to license terms.  
Installation of <SUNWixgedu> was successful.  
Copyright 2004 Sun Microsystems, Inc. All rights reserved.  
Use is subject to license terms.  
Installation of <SUNWixgea> was successful.  
Chapter 2 Installing the Adapter  
 
13  
CODE EXAMPLE 2-1  
Typical Install Script Output (Continued)  
Installation completed.  
10-Gigabit Ethernet Driver packages have been installed.  
Optional VLAN Utility has been updated using 114600-04. It  
may be necessary to reboot the system to reload the updated  
driver.  
A log of this Install can be found at:  
/var/tmp/10_Gigabit.install.2004.12.10.1029  
5. Reboot the system to load the driver:  
# reboot -r  
6. Verify the installation to ensure that the driver installed and loaded properly.  
Verifying the Software Installation  
Unless you have the latest version of the driver software installed, the green LEDs  
on the adapter will not go on. Be sure that you have version 1.30 or later installed.  
Use the modinfocommand to verify that you have the current driver (v1.30 or  
later) installed.  
If you type grep IXGE, using uppercase letters, you will get only the specific driver  
information:  
# modinfo | grep IXGE  
267 1331c11 11e0e 271 1 ixge (IXGE 10Gb Ethernet Driver v1.30)  
14  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
 
Configuring the Network Host Files  
After installing the driver software, you must create a hostname.ixgenumber file  
where number = the instance number of the ixgeinterface.) for the adapter’s  
Ethernet interface. You must also create both an IP address and a host name for its  
Ethernet interface in the /etc/hostsfile.  
Caution – Ensure that the optical transceiver is correctly seated before configuring  
the interface.  
1. At the command line, use the grepcommand to search the /etc/path_to_inst  
file for ixgeinterfaces.  
# grep ixge /etc/path_to_inst  
"/pci@9,600000/ethernet@1" 0 "ixge"  
In the example above, the device instance is from a Sun 10-Gigabit Ethernet PCI-X  
adapter. For clarity, the instance number is in bold italics.  
2. Use the ifconfigcommand to set up the adapter’s ixgeinterface.  
Use the ifconfigcommand to assign an IP address to the network interface. Type  
the following at the command line, replacing ip-address with the adapter’s IP  
address:  
# ifconfig ixge0 plumb ip-address up  
Caution – If the optical transceiver is unplugged after the interface has been  
configured using the ifconfigcommand, you must unconfigure and reconfigure  
the interface.  
On Solaris operating systems, use the following commands to unconfigure and  
reconfigure the interface:  
# ifconfig ixge0 down  
# ifconfig ixge0 unplumb  
# ifconfig ixge0 plumb ip-address up  
Chapter 2 Installing the Adapter  
 
15  
       
On Linux operating systems, use the following commands:  
ifconfig ethnumber down  
ifconfig ethnumber up  
Where number corresponds to the device instance of the Sun 10-Gigabit Ethernet  
PCI-X adapter you plan to configure.  
Refer to the ifconfig(1M) man page and the Solaris or Linux documentation for  
more information.  
If you want a setup that remains the same after you reboot, create an  
/etc/hostname.ixgenumber file, where number corresponds to the instance  
number of the ixgeinterface you plan to use.  
To use the adapter’s ixgeinterface in the Step 1 example, create an  
/etc/hostname.ixge0file, where 0is the number of the ixgeinterface. If the  
instance number were 1, the filename would be  
/etc/hostname.ixge1.  
Do not create an /etc/hostname.ixgenumber file for a Sun 10-Gigabit Ethernet  
adapter interface you plan to leave unused.  
The /etc/hostname.ixgenumber file must contain the hostname and IP address  
for the appropriate ixgeinterface.  
The host name and IP address must be listed in the /etc/hostsfile.  
The host name must be different from any other host name of any other interface,  
for example: /etc/hostname.ixge0and /etc/hostname.ixge1cannot share  
the same host name.  
The following example shows the /etc/hostname.ixgenumber file required for a  
system called zardozthat has a Sun 10-Gigabit Ethernet adapter (zardoz-11).  
# cat /etc/hostname.hme0  
zardoz  
# cat /etc/hostname.ixge0  
zardoz-11  
16  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
 
3. Create an appropriate entry in the /etc/hostsfile for each active ixgeinterface.  
For example:  
# cat /etc/hosts  
#
# Internet host table  
#
127.0.0.1  
localhost  
129.144.10.57 zardoz  
loghost  
129.144.11.83 zardoz-11  
Chapter 2 Installing the Adapter  
 
17  
18  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
CHAPTER  
3
This chapter describes how to configure the driver parameters used by the Sun 10-  
Gigabit Ethernet PCI-Xadapter. This chapter contains the following sections:  
“10-Gigabit Ethernet Device Driver Parameters” on page 19  
“Setting ixgeDriver Parameters” on page 23  
“10-Gigabit Ethernet Driver Operating Statistics” on page 29  
10-Gigabit Ethernet Device Driver  
Parameters  
The ixgedevice driver controls the Sun 10-Gigabit Ethernet PCI-X adapter. The  
ixgedriver is attached to the UNIX pciname property pci8086,1048for the Sun  
10-Gigabit Ethernet PCI-X adapter (8086is the vendor ID and 1048is the PCI  
device ID).  
You can manually configure the ixgedevice driver parameters to customize each  
Sun 10-Gigabit Ethernet adapter device in your system. This section provides an  
overview of the capabilities of the 10-Gigabit Ethernet driver used in the adapter,  
lists the available ixgedevice driver parameters, and describes how to configure  
these parameters.  
19  
 
         
10-Gigabit Ethernet Driver Parameter Values and  
Definitions  
TABLE 3-1 describes the parameters and settings for the ixgedevice driver.  
TABLE 3-1 ixgeDriver Parameter, Status, and Descriptions  
Parameter  
Status  
Description  
instance  
Read and write  
Read and write  
Read and write  
Read and write  
Read and write  
Read and write  
Device instance  
adv-asmpause-cap  
adv-pause-cap  
rx-intr-pkts  
rx-intr-time  
accept-jumbo  
Flow control parameter  
Flow control parameter  
Receive interrupt blanking values  
Receive interrupt blanking values  
Enable jumbo frames  
Flow Control Parameters  
The ixgedevice sources (transmits) and terminates (receives) pause frames  
conforming to the IEEE 802.3x Frame Based Link Level Flow Control Protocol. In  
response to received flow control frames, the ixgedevice can slow down its  
transmit rate. The ixgedevice is capable of sourcing flow control frames by  
requesting the link partner to slow down, provided that the link partner supports  
this feature. By default, the driver advertises both transmit and receive pause  
capability during autonegotiation.  
20  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
           
TABLE 3-2 provides flow control keywords and describes their function.  
TABLE 3-2  
Keyword  
Read-Write Flow Control Keyword Descriptions  
Description  
adv_asmpause_cap  
The adapter supports asymmetric pause, which means it  
can pause only in one direction.  
0=Off (default)  
1=On  
adv_pause_cap  
This parameter has two meanings, each depending on the  
value of adv_asmpause_cap. (Default=0)  
• If adv_asmpause_cap= 1 while adv_pause_cap= 1,  
pauses are received.  
• If adv_asmpause_cap= 1 while adv_pause_cap= 0,  
pauses are transmitted.  
• If adv_asmpause_cap= 0 while adv_pause_cap= 1,  
pauses are sent and received.  
• If adv_asmpause_cap= 0, then adv_pause_cap  
determines whether Pause capability is on or off.  
Interrupt Parameters  
TABLE 3-3 describes the receive interrupt blanking values.  
TABLE 3-3  
RX Blanking Register for Alias Read  
Field Name  
Values  
Description  
rx_intr_pkts  
0 to 511  
Interrupt after this number of packets have arrived since  
the last packet was serviced. A value of zero indicates no  
packet blanking. (Default=3)  
rx_intr_time  
0 to 32768  
Interrupt after 4.5 US ticks have elapsed since the last  
packet was serviced. A value of zero indicates no time  
blanking. (Default=0)  
Chapter 3 Configuring Driver Parameters  
21  
 
         
Jumbo Frames  
The variable accept-jumboenables the driver to instruct the upper layers that the  
driver is operating in Jumbo-frame mode.  
TABLE 3-4 accept-jumbo Parameters  
Parameter  
Values  
Description  
accept-jumbo  
1
Enables Jumbo-frame mode and sets MTU to  
greater than 1500.  
0
Jumbo frames is not enabled. MTU is at  
1500.  
Refer to the documentation that came with your switch for exact commands to  
configure jumbo frames support.  
To Configure Jumbo Frames Using ndd  
1. Unplumb the interface you want to configure Jumbo Frames on.  
2. Kill any snoopor netstatprocesses running over the interface to be configured.  
3. Set the instance number:  
% ndd -set /dev/ixge instance 0  
In this example, the instance number set is 0.  
4. Set the instance to accept jumbo frames:  
% ndd -set /dev/ixge accept-jumbo 1  
5. Plumb the interface up:  
% ifconfig ixge0 plumb xxx.xxx.xx.xxx up  
where xxx.xxx.xx.xxx = the IP address of the interface.  
22  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
     
To Configure Jumbo Frames in a Linux  
Environment  
1. Ensure that the ixgesoftware is installed.  
2. Plumb the Sun 10-Gigabit Ethernet PCI-X interface:  
# modprobe ixge  
# ifconfig eth2 xxx.xxx.xx.xxx up  
# ifconfig eth2 mtu 8170  
where xxx.xxx.xx.xxx = the IP address of the interface.  
Setting ixgeDriver Parameters  
You can set the ixgedevice driver parameters in two ways:  
Using the nddutility  
Using the ixge.conffile  
If you use the nddutility, the parameters are valid only until you reboot the system.  
This method is good for testing parameter settings.  
To set parameters so they remain in effect after you reboot the system, create a  
/platform/sun4u/kernel/drv/ixge.conffile and add parameter values to this  
file when you need to set a particular parameter for a device in the system.  
Setting Parameters Using the nddUtility  
Use the nddutility to configure parameters that are valid until you reboot the  
system. The nddutility supports any networking driver that implements the Data  
Link Provider Interface (DLPI).  
The following sections describe how you can use the ixgedriver and the nddutility  
to modify (with the -setoption) or display (without the -setoption) the  
parameters for each ixgedevice.  
Chapter 3 Configuring Driver Parameters  
 
23  
       
To Specify Device Instances for the nddUtility  
Before you use the nddutility to get or set a parameter for a ixgedevice, you must  
specify the device instance for the utility.  
1. Check the /etc/path_to_instfile to identify the instance associated with a  
particular device.  
# grep ixge /etc/path_to_inst  
"/pci@9,600000/ethernet@1" 0 "ixge"  
In this example, the 10-Gigabit Ethernet instance is from the installed adapter. The  
instance number is in bold italics for clarity.  
2. Use the instance number to select the device.  
# ndd -set /dev/ixge instancenumber  
The device remains selected until you change the selection.  
Noninteractive and Interactive Modes  
You can use the nddutility in two modes:  
Noninteractive  
Interactive  
In noninteractive mode, you invoke the utility to execute a specific command. Once  
the command is executed, you exit the utility. In interactive mode, you can use the  
utility to get or set more than one parameter value. Refer to the ndd(1M) man page  
for more information.  
To Use the nddUtility in Noninteractive Mode  
This section describes how to modify and display parameter values.  
24  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
         
To modify a parameter value, use the -setoption.  
If you invoke the nddutility with the -setoption, the utility passes value, which  
must be specified, down to the named /dev/ixgedriver instance, and assigns the  
value to the parameter:  
# ndd -set /dev/ixge parameter value  
When you change any parameter, a message similar to the following appears:  
ixge0: xcvr addr:0x01 - link up 10000 Mbps full duplex  
To display the value of a parameter, specify the parameter name and omit the  
value.  
When you omit the -setoption, the utility queries the named driver instance,  
retrieves the value associated with the specified parameter, and prints it:  
# ndd /dev/ixge parameter  
To Use the nddUtility in Interactive Mode  
To modify a parameter value in interactive mode, specify ndd /dev/ixge:  
name to get/set? (Enter the parameter name or ? to view all  
parameters)  
After you enter the parameter name, the nddutility prompts you for the parameter  
value (see TABLE 3-1 through TABLE 3-6).  
Chapter 3 Configuring Driver Parameters  
 
25  
 
To list all the parameters supported by the ixgedriver, type ?.  
See TABLE 3-1 through TABLE 3-6 for parameter descriptions.  
# ndd -get /dev/ixge \?  
?
(read only)  
instance  
(read and write)  
(read and write)  
(read and write)  
(read and write)  
(read and write)  
(read and write)  
(read and write)#  
adv_asmpause_cap  
adv_pause_cap  
rx_intr_pkts  
rx_intr_time  
accept_jumbo  
laggr_multistream  
Note – By default, autonegotiation is set to off. This adapter operates only at full-  
duplex.  
Specify the driver parameter properties for each device by creating a ixge.conffile  
in the /platform/sun4u/kernel/drvdirectory. Use a ixge.conffile when you  
need to set a particular parameter for a device in the system. The parameters you  
can set are the read and write parameters listed in “10-Gigabit Ethernet Driver  
Parameter Values and Definitions” on page 20.  
Note – Configuring the parameters by putting nddcommands in rcX.dscripts is  
not supported.  
The man pages for prtconf(1M) and driver.conf(4) include additional details.  
The next procedure shows an example of setting parameters in a ixge.conffile.  
To access any man page, type the mancommand plus the name of the man page.  
For example, to access man pages for prtconf(1M), type:  
% man prtconf  
26  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
   
To Set Driver Parameters Using a ixge.conf  
File  
1. Obtain the hardware path names for the ixgedevices in the device tree.  
a. Check the /etc/driver_aliasesfile to identify the name associated with a  
particular device:  
# grep ixge /etc/driver_aliases  
ixge "pci8086,1048.108e.7036"  
Note – ixge "pci8086,1048.108e.7036" is used by the Sun 10-Gigabit Ethernet  
adapter.  
b. Locate the path names and the associated instance numbers in the  
/etc/path_to_instfile.  
# grep ixge /etc/path_to_inst  
"/pci@9,600000/ethernet@1" 0 "ixge"  
Chapter 3 Configuring Driver Parameters  
 
27  
 
In this example:  
The first part within the double quotes specifies the hardware node name in  
the device tree.  
The number not enclosed in quotes is the instance number (shown in bold  
italics).  
The last part in double quotes is the driver name.  
In the hardware node name, the last component after the last /character and  
before the @character is the device name.  
The path name before the last component is the parent name.  
The number after the final @character within quotes is the unit-address.  
To identify a PCI device unambiguously in the ixge.conffile, use the name, parent  
name, and the unit-address for the device. Refer to the pci(4) man page for more  
information about the PCI device specification.  
2. Set the parameters for the above devices in the  
/platform/sun4u/kernel/drv/ixge.conffile.  
In the following example, the accept-jumbo parameter is set to enable jumbo  
frames for all Sun 10-Gigabit Ethernet devices. See the driver.conf(4)man page  
for more information.  
accept-jumbo=1;  
In the following example, the accept-jumbo parameter is set to enable jumbo  
frames is set for a single instance of the Sun 10-Gigabit Ethernet device.  
In this example:  
parent= "/pci@8,600000"  
unit-address= "0"  
name="pci8086,1048.108e.7036" parent="pci@8,600000" unit-address=  
"0" accept-jumbo=1;  
Note – If you omit the name=, parent=, and unit-address= definitions, the  
settings become global to all Sun 10-Gigabit Ethernet instances.  
3. Save the ixge.conffile.  
28  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
10-Gigabit Ethernet Driver Operating  
Statistics  
These statistics are part of the statistics presented by the kstatcommand.  
TABLE 3-5 describes the read-only Media Independent Interface (MII) capabilities.  
These parameters define the capabilities of the hardware. The Gigabit Media  
Independent Interface (GMII) supports all of the following capabilities.  
TABLE 3-5  
Parameter  
Read-Only ixgeDevice Capabilities  
Description (Local interface Capabilities)  
cap_autoneg  
cap_10gfdx  
0 = Not capable of autonegotiation  
1 = Autonegotiation capable  
Local interface full-duplex capability  
0 = Not 10000 Mbit/sec full-duplex capable  
1 = 10000 Mbit/sec full-duplex capable  
cap_10ghdx  
cap_1000fdx  
cap_1000hdx  
cap_100fdx  
cap_100hdx  
cap_10fdx  
Local interface half-duplex capability  
0 = Not 10000 Mbit/sec half-duplex capable  
1 = 10000 Mbit/sec half-duplex capable  
Local interface full-duplex capability  
0 = Not 1000 Mbit/sec full-duplex capable  
1 = 1000 Mbit/sec full-duplex capable  
Local interface half-duplex capability  
0 = Not 1000 Mbit/sec half-duplex capable  
1 = 1000 Mbit/sec half-duplex capable  
Local interface full-duplex capability  
0 = Not 100 Mbit/sec full-duplex capable  
1 = 100 Mbit/sec full-duplex capable  
Local interface half-duplex capability  
0 = Not 100 Mbit/sec half-duplex capable  
1 = 100 Mbit/sec half-duplex capable  
Local interface full-duplex capability  
0 = Not 10 Mbit/sec full-duplex capable  
1 = 10 Mbit/sec full-duplex capable  
Chapter 3 Configuring Driver Parameters  
 
29  
   
TABLE 3-5  
Read-Only ixgeDevice Capabilities (Continued)  
Parameter  
Description (Local interface Capabilities)  
cap_10hdx  
Local interface half-duplex capability  
0 = Not 10 Mbit/sec half-duplex capable  
1 = 10 Mbit/sec half-duplex capable  
cap_asm_pause  
cap_pause  
Local interface flow control capability  
0 = Not asymmetric pause capable  
1 = Asymmetric pause (from the local device) capable  
Local interface flow control capability  
0 = Not Symmetric pause capable  
1 = Symmetric pause capable  
Table describes the read-only ixge device capabilities.  
TABLE 3-6 describes the kstat ixge:1receive and transmit parameters:  
TABLE 3-6  
Receive and Transmit Parameters  
Parameter  
lb_mode  
rev_id  
Description  
Copy of the Loopback mode the device is in, if any.  
Revision ID of the 10-Gigabit Ethernet device useful for  
recognition of device being used in the field.  
rx_allocb_fail  
rx_hdr_drops  
Number of times the driver failed to allocate OS receive buffer.  
Number of times an entire page of packets less than 256 bytes  
each was dropped because the driver was unable to map a new  
page to replace it.  
rx_hdr_pkts  
rx_inits  
Number of packets received that were less than 256 bytes.  
Number of packets received  
rx_jumbo_pkts  
rx_len_mm  
Number of jumbo packets received.  
Receive length error count.  
rx_msgdup_fail  
rx_mtu_drops  
Number of times driver failed to duplicate a packet on receipt.  
Number of times an entire page of packets greater than 256 bytes  
and less than 1514 each was dropped because the driver was  
unable to map a new page to replace it.  
rx_new_hdr_pgs  
rx_new_mtu_pgs  
rx_new_nxt_pgs  
Number of pages that were filled with packets less than 256 bytes  
that got replaced during reception.  
Number of pages that were filled with packets greater than 256  
bytes and less than 1514 that got replaced during reception.  
Number of pages that contained packets that were split across  
pages that got replaced during reception.  
30  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
 
TABLE 3-6  
Parameter  
Receive and Transmit Parameters  
Description  
rx_new_pages  
rx_no_buf  
Number of pages that got replaced during reception.  
Number of times the hardware cannot receive data because there  
is no more receive buffer space.  
rx_nocanput  
rx_no_comp_wb  
rx_nxt_drops  
Number of packets dropped due to full STREAMS message  
queue.  
Number of times the hardware cannot post completion entries for  
received data.  
Number of times a page with a split packet was dropped because  
the driver was unable to map a new one to replace it.  
rx_ov_flow  
Number of packets dropped due to full h/w FIFO.  
Number of packets dropped due to service FIFO.  
Number of times driver able to reuse a system page.  
Number of packets that were split across two pages.  
System snapshot time in seconds.  
rx_pkts_dropped  
rx_reused_pgs  
rx_split_pkts  
snaptime  
trunk_mode  
A value of 1 indicates that a link is aggregated.  
Number of times driver failed to duplicate a packet on transmit.  
Number of packets that used DDI_DMA.  
tx_allocb_fail  
tx_ddi_pkts  
tx_dma_bind_fail  
Number of times a page table entry was not available to enable  
the driver to map the kernel memory to device-accessible  
memory for transmission.  
tx_dvma_pkts  
tx_hdr_pkts  
tx_jumbo_pkts  
tx_max_pend  
Number of packets that used dvma.  
Number of packets that used bcopy (buffer copy).  
Number of packets greater that Ethernet MTU of 1522.  
Maximum number of transmits pending on any of the four  
queues.  
tx_msgdup_fail  
Number of times driver failed to duplicate a packet for  
promiscuous stream.  
tx_no_desc  
tx_starts  
xcvr_addr  
Number of tx packets dropped due to full descriptor ring.  
Number of times that the driver attempted to transmit a packet.  
GMII/MII physical layer device address for management  
interface.  
Chapter 3 Configuring Driver Parameters  
31  
 
TABLE 3-6  
Receive and Transmit Parameters  
Parameter  
Description  
xcvr_id  
GMII/MII physical layer device Identification Decimal copy of  
MII registers 2 and 3.  
xcvr_inits  
xcvr_inuse  
Number of physical layer re-initializations incremented each time  
link parameters are changed using NDD.  
Type of Transceiver/SERDES which is always PCS (3).  
To Check Link Partner Settings  
Type the kstatcommand as superuser:  
CODE EXAMPLE 3-1  
Output from kstatCommand  
# kstat ixge:1  
module: ixge  
name: ixge1  
instance: 1  
class:  
net  
brdcstrcv  
0
brdcstxmt  
cap_1000fdx  
cap_1000hdx  
cap_100fdx  
cap_100hdx  
cap_100T4  
cap_10fdx  
cap_10gfdx  
cap_10ghdx  
cap_10hdx  
cap_asmpause  
cap_autoneg  
cap_pause  
crc_err  
0
0
0
0
0
0
0
1
0
0
0
0
0
0
crtime  
147.15892392  
ierrors  
2
ifspeed  
10000000000  
ipackets  
0
ipackets64  
lb_mode  
0
0
link_asmpause  
link_duplex  
link_pause  
link_speed  
link_T4  
link_up  
local_faults  
mac_mtu  
0
2
0
10000  
0
1
1
0
32  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
   
CODE EXAMPLE 3-1  
Output from kstatCommand (Continued)  
multircv  
multixmt  
0
0
norcvbuf  
0
noxmtbuf  
0
obytes  
0
obytes64  
0
oerrors  
0
opackets  
0
opackets64  
pci_bad_ack_err  
pci_bus_speed  
pci_dmarz_err  
pci_dmawz_err  
pci_drto_err  
pci_err  
0
0
100  
0
0
0
0
pci_parity_err  
pci_rma_err  
pci_rta_err  
pcix_bus_mode  
promisc  
0
0
0
1
off  
0
qos_mode  
rbytes  
0
rbytes64  
0
remote_faults  
rev_id  
rx_allocb_fail  
rx_hdr_drops  
rx_hdr_pkts  
rx_inits  
1
28726  
0
0
0
0
rx_jumbo_pkts  
rx_len_mm  
0
0
rx_msgdup_fail  
rx_mtu_drops  
rx_mtu_pkts  
rx_new_hdr_pgs  
rx_new_mtu_pgs  
rx_new_nxt_pgs  
rx_new_pages  
rx_no_buf  
0
0
0
0
0
0
0
0
rx_nocanput  
rx_no_comp_wb  
rx_nxt_drops  
rx_ov_flow  
rx_pkts_dropped  
rx_reused_pgs  
rx_split_pkts  
rx_tag_err  
0
0
0
0
0
0
0
0
Chapter 3 Configuring Driver Parameters  
33  
 
CODE EXAMPLE 3-1  
Output from kstatCommand (Continued)  
rx_taskq_waits  
snaptime  
0
7883.09014984  
trunk_mode  
tx_allocb_fail  
tx_ddi_pkts  
tx_dma_bind_fail  
tx_dvma_pkts  
tx_hdr_pkts  
tx_inits  
tx_jumbo_pkts  
tx_max_pend  
tx_msgdup_fail  
tx_nocanput  
tx_no_desc  
tx_starts  
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
3
tx_uflo  
xcvr_addr  
xcvr_id  
xcvr_inits  
xcvr_inuse  
To Discover Device Capabilities  
Use the kstatcommand to discover device capabilities.  
# kstat ixge:1 | grep cap_  
cap_1000fdx  
cap_1000hdx  
cap_100fdx  
cap_100hdx  
cap_100T4  
0
0
0
0
0
0
1
0
0
0
0
0
cap_10fdx  
cap_10gfdx  
cap_10ghdx  
cap_10hdx  
cap_asmpause  
cap_autoneg  
cap_pause  
34  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
 
To Discover Link Settings  
Use the kstatcommand to discover link settings.  
# kstat ixge:1 | grep link  
link_asmpause  
link_duplex  
link_pause  
0
2
0
link_speed  
10000  
link_T4  
link_up  
0
1
Configuration Checking  
The jumbo frame configuration checking occurs at Layer 2 or Layer 3, depending on  
the configuration method.  
Layer 2 Configuration Checking  
You can view the MTU configuration of a ixgeinstance at any time using the kstat  
command. The kstatmac_mtu variable represents the complete size of the  
Ethernet frame, which includes the Ethernet header, maximum payload, and crc.  
This value is consistent with the definition of MTU presented by switch vendors.  
Use the following command to get the information:.  
# kstat ixge:0 | grep mac_mtu  
mac_mtu  
8192  
Layer 3 Configuration Checking  
You can check the Layer 3 configuration by invoking the ifconfigcommand on a  
preconfigured interface as shown in the previous examples:.  
# ifconfig ixge138000  
ixge138000: flags=  
201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu  
8170 index 5  
inet 192.12.38.69 netmask ffffff00 broadcast 192.12.38.255  
ether 0:3:ba:c4:f7:1d  
Chapter 3 Configuring Driver Parameters  
 
35  
   
36  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
CHAPTER  
4
This chapter explains Virtual Local Area Networks (VLANs) in detail and provides  
configuration instructions and examples. It contains the following sections:  
“Overview of VLANs” on page 37  
“Configuring VLANs” on page 39  
With multiple VLANs on an adapter, a server with a single adapter can have a  
logical presence on multiple IP subnets. By default, 128 VLANs can be defined for  
each VLAN-aware adapter on your server. However, this number can be increased  
by changing the system parameters.  
If your network does not require multiple VLANs, you can use the default  
configuration, in which case no further configuration is necessary.  
Note – If you change any of the VLAN configuration parameters, you must reboot  
the system before the changes take effect. If you make changes and do not reboot,  
you may experience configuration problems.  
Overview of VLANs  
VLANs enable you to split your physical LAN into logical subparts, providing an  
essential tool for increasing the efficiency and flexibility of your network.  
VLANs are commonly used to separate groups of network users into manageable  
broadcast domains, to create logical segmentation of workgroups, and to enforce  
security policies among each logical segment. Each defined VLAN behaves as its  
own separate network, with its traffic and broadcasts isolated from the others,  
increasing the bandwidth efficiency within each logical group.  
37  
 
       
Although VLANs are commonly used to create individual broadcast domains  
and/or separate IP subnets, it can be useful for a server to have a presence on more  
than one VLAN simultaneously. Several Sun products support multiple VLANs on a  
per port or per interface basis, allowing very flexible network configurations.  
FIGURE 4-1 shows an example network that uses VLANs.  
Main Server  
Accounting  
Server  
(VLAN 3)  
Adapter  
Gigabit/Tagged  
(All VLANs)  
VLAN 1  
VLAN 2  
VLAN 3  
Shared  
Media  
Segment  
Software  
PC 1  
(VLAN 2)  
Software  
PC 2  
(VLAN 2)  
Engineering  
PC 3  
(VLAN 1)  
Accounting  
PC 4  
(VLAN 3)  
Engineering/  
Software PC 5  
Adapter  
Gigabit/Tagged  
(VLAN 1 & 2)  
FIGURE 4-1 Example of Servers Supporting Multiple VLANs With Tagging Adapters  
The example network has the following features:  
The physical LAN network consists of a switch, two servers, and five clients. The  
LAN is logically organized into three different VLANs, each representing a different  
IP subnet.  
VLAN 1 is an IP subnet consisting of the Main Server, Client 3, and Client 5. This  
represents an engineering group.  
38  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
 
VLAN 2 includes the Main Server, Clients 1 and 2 by means of a shared media  
segment, and Client 5. This is a software development group.  
VLAN 3 includes the Main Server, the Accounting Server and Client 4. This is an  
accounting group.  
The Main Server is a high-use server that needs to be accessed from all VLANs and  
IP subnets. The server has a Sun 10-Gigabit Ethernet adapter installed. All three IP  
subnets are accessed by means of the single physical adapter interface. The server is  
attached to one of the switch’s Gigabit Ethernet ports, which is configured for  
VLANs 1, 2, and 3. Both the adapter and the connected switch port have tagging  
turned on. Because of the tagging VLAN capabilities of both devices, the sever is  
able to communicate on all three IP subnets in this network, but continues to  
maintain broadcast separation between all of them. The following list describes the  
components of this network:  
The Accounting Server is available to VLAN 3 only. It is isolated from all traffic  
on VLANs 1 and 2. The switch port connected to the server has tagging turned  
off.  
Clients 1 and 2 are attached to a shared media hub that is then connected to the  
switch. They belong to VLAN 2 only, and are logically in the same IP subnet as  
the Main Server and Client 5. The switch port connected to this segment has  
tagging turned off.  
Client 3 is a member of VLAN 1, and can communicate only with the Main Server  
and Client 5. Tagging is not enabled on Client 3’s switch port.  
Client 4 is a member of VLAN 3, and can communicate only with the servers.  
Tagging is not enabled on Client 4’s switch port.  
Client 5 is a member of both VLANs 1 and 2, and has a Sun 10-Gigabit Ethernet  
adapter installed. It is connected to switch port 10. Both the adapter and the  
switch port are configured for VLANs 1 and 2 and have tagging enabled.  
VLAN tagging is only required to be enabled on switch ports that create trunk links  
to other VLAN-aware Ethernet switches, or on ports connected to tag-capable end-  
stations, such as servers or workstations with VLAN-aware adapters.  
Configuring VLANs  
VLANs can be created according to various criteria, but each VLAN must be  
assigned a VLAN tag or VLAN ID (VID). The VID is a 12-bit identifier between 1  
and 4094 that identifies a unique VLAN. For each network interface (ixge0, ixge1,  
ixge2and so on), 4094 possible VLAN IDs can be selected. Only 512 unique IDs can  
be used simultaneously. Because IP subnets are commonly used, it is best to use IP  
Chapter 4 Configuring VLANs  
 
39  
     
subnets when setting up a VLAN network interface. This means that each VID  
assigned to a VLAN interface of a physical network interface will belong to different  
subnets.  
Tagging an Ethernet frame requires the addition of a tag header to the frame. The  
header is inserted immediately following the destination MAC address and the  
Source MAC address. The tag header consists of two bytes of Ethernet Tag Protocol  
identifier (TPID, 0x8100) and two bytes of Tag Control Information (TCI). FIGURE 4-2  
shows the Ethernet Tag Header format.  
Octet  
1
TPID (0x8100  
2
3 bits  
3
1
bit  
12 bytes  
4
User_priority  
VID  
CFI  
FIGURE 4-2 Ethernet Tag Header Format  
By default, a single VLAN is configured for every port, which groups all ports into  
the same broadcast domain, just as if there were no VLANs at all, VLAN tagging for  
the switch port turned off.  
Note – If you configure a VLAN virtual device for an adapter, all traffic sent or  
received by that adapter must be in VLAN-tagged format.  
To Configure Static VLANs  
1. Create one hostname6.ixgenumber file for each VLAN that will be configured for  
each adapter on the server.  
Use the following naming format, which includes both the VID and the physical  
point of attachment (PPA):  
VLAN logical PPA = 1000 * VID + Device PPA  
ixge123000 = 1000*123 + ixge  
This format limits the maximum number of PPAs (instances) you can configure to  
1000 in the /etc/path_to_instfile.  
For example, on a server with the Sun 10-Gigabit Ethernet adapter having an  
instance of 0, belonging to a member of two VLANs, with VID 123 and 224, you  
would use ixge123000and ixge224000, respectively, as the two VLAN PPAs.  
40  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
     
2. Use the ifconfig(1M)to configure a VLAN virtual device, for example:  
# ifconfig ixge123000 plumb up  
# ifconfig ixge4000 plumb up  
The output of ifconfig -aon a system having VLAN devices ixge123000and  
ixge224000:  
# ifconfig -a  
lo0: flags=1000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4> mtu 8232 index 1  
inet 127.0.0.1 netmask ff000000  
hme0: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 2  
inet 129.144.131.91 netmask ffffff00 broadcast 129.144.131.255  
ether 8:0:20:a4:4f:b8  
ixge123000: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 3  
inet 199.199.123.3 netmask ffffff00 broadcast 199.199.123.255  
ether 8:0:20:a4:4f:b8  
ixgee224000: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index  
4
ether 8:0:20:a4:4f:b8  
3. On the switch, set VLAN tagging and set VLAN ports to coincide with the VLANs  
you’ve set up on the server.  
Using the examples in Step 2, you would set up VLAN ports 123 and 224 on the  
switch.  
Refer to the documentation that came with your switch for specific instructions for  
setting VLAN tagging and ports.  
Chapter 4 Configuring VLANs  
 
41  
     
42  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
APPENDIX  
A
This appendix provides specifications for the Sun 10-Gigabit Ethernet PCI-X adapter.  
“Performance Specifications” on page 43  
“Physical Characteristics” on page 44  
“Power Requirements” on page 44  
Performance Specifications  
TABLE A-1 Performance Specifications  
Feature  
Specification  
66 to 133 MHz max  
66 MHz  
PCI-X clock  
PCI clock  
PCI I/O voltage  
PCI data burst transfer rate  
PCI data/address width  
PCI modes  
3.3V  
Up to 64-byte bursts  
64 bit  
Master/slave  
Maximum Ethernet transfer rate 10 Gbps Ethernet  
Optics XG-Base-SR, XG-Base-LR and IEEE 802.ae, 2002  
compliant  
43  
 
       
Physical Characteristics  
TABLE A-2 Physical Characteristics  
Dimension  
Length  
Width  
Measurement  
6.6 inches (167.64 mm)  
2.536 inches (64.61 mm)  
Height  
Height on component side: 0.57 inches (14.48 mm)  
Height on back side :0.105 inches (2.67 mm)  
Power Requirements  
TABLE A-3 Power Requirements  
Specification  
Measurement  
Maximum power consumption  
Voltage  
11 Watts  
3.3V and 5V  
44 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
         
APPENDIX  
B
Diagnostic Software  
This appendix provides an overview of the SunVTS diagnostic application and  
instructions for updating the SunVTS software to recognize the adapter. This  
appendix contains the following sections:  
“SunVTS Diagnostic Software” on page 45  
“Updating SunVTS to Recognize the Adapter” on page 46  
“Using the SunVTS netlbtest” on page 47  
SunVTS Diagnostic Software  
The SunVTS software executes multiple diagnostic hardware tests from a single user  
interface and is used to verify the configuration and functionality of most hardware  
controllers and devices. The SunVTS software operates primarily from a graphical  
user interface, enabling test parameters to be set quickly and easily while a  
diagnostic test operation is being performed.  
Note – SunVTS diagnostic software is not currently available for Solaris x86  
Operating Systems.  
The SunVTS nettestdiagnostic can be used to test all of the networking interfaces  
on the system, including the interfaces on the adapter.  
To use the nettestdiagnostic, you must have the SunVTS software installed on  
your system. Refer to your Solaris documentation for installation instructions.  
Refer to the SunVTS documentation (listed in TABLE B-1) for instructions on how to  
run and monitor the nettestdiagnostic. These SunVTS documents are available  
online at the following URL:  
45  
 
         
/system_administration/tools/testing_valid/sunvts/index.html  
Select the document for the Solaris release on your system.  
TABLE B-1 SunVTS Documentation  
Title  
Description  
SunVTS User’s Guide  
Describes the SunVTS diagnostic environment  
SunVTS Test Reference Manual  
Describes each SunVTS test (including the nettest)  
and describes the various test options and  
command-line arguments  
SunVTS Quick Reference  
Provides an overview of the user interface  
Updating SunVTS to Recognize the  
Adapter  
Current versions of SunVTS do not recognize the Sun 10-Gigabit Ethernet PCI-X  
adapter. You will need to update the SunVTS configuration.  
To Update SunVTS to Recognize the Adapter  
1. Plug in a loopback cable.  
2. Ensure that the SunVTS software and the ixgedriver are installed on your  
system.  
3. Add the following lines to the /opt/SUNWvts/lib/conf/netlbtest.confand  
/opt/SUNWvts/lib/conf/nettest.conffiles:  
ixge  
ixge  
10GbE  
46 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
       
Using the SunVTS netlbtest  
You must have the Ethernet card and the device driver installed, a loopback  
connector in place, and Intervention mode enabled before running netlbtest.  
netlbtestcannot run if the network interface is connected to a live network, and  
requires that the Ethernet device be configured offline before running the test. Use  
the ifconfig(1M)command to bring the Ethernet device down before running  
netlbtest.  
To Use the netlbtest  
1. Ensure that the SunVTS software and the ixgedriver are installed on your  
system.  
2. Plug in a loopback cable.  
3. Unplumb the interface from the system, using the ifconfigcommand:  
# ifconfig ixgeinstance down  
# ifconfig ixgeinstance unplumb  
Where instance is the instance number of the interface.  
Refer to SunVTS documentation for instructions on how to run netlbtest.  
Appendix B  
Diagnostic Software  
47  
 
   
48 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
APPENDIX  
C
Installing the Software Manually  
This appendix describes how to install the driver software manually.  
The Sun 10-Gigabit Ethernet Adapter CD contains the driver software required to  
operate the adapter. When you update your Solaris operating system, refer to the  
documentation that shipped with the Solaris Supplement CD-ROM for a listing of the  
available network drivers. Install the Sun 10-Gigabit Ethernet driver for your  
updated version of the Solaris Operating System.  
To Install the Driver Software Manually  
1. Become superuser.  
2. Insert the Sun 10-Gigabit Ethernet Adapter CD into a CD-ROM drive that is  
connected to your system.  
If your system is running Sun Enterprise Volume Manager™, the system should  
automatically mount the CD-ROM to the /cdrom/cdrom0directory.  
49  
 
     
If your system is not running Volume Manager, mount the CD-ROM as follows:  
# mkdir /cdrom  
# mkdir /cdrom/cdrom0  
# mount -F hsfs -o ro /dev/dsk/c0t6d0s2 /cdrom/cdrom0  
You will see the following files and directories in the  
/cdrom/sun_10-gigabit_ethernet_driverdirectory or the  
/cdrom/cdrom0directory, depending on how you mounted the CD-ROM.  
TABLE C-1 Files and Directories on the CD-ROM  
File or Directory  
Contents  
Copyright  
U.S. copyright file  
French copyright file  
FR_Copyright  
10_GigabitEthernet/Linux/SRPM/  
Contains the Sun 10-Gigabit Ethernet software source  
rpm applicable to Linux operating systems:  
• sun-10-gigabit-kernel-1.0.version-1.src.rpm  
10_GigabitEthernet/Solaris_OS-VER  
/ARCH/Packages/  
Contains the Sun 10-Gigabit Ethernet software packages  
applicable to SPARC architecture software:  
• SUNWixgea—adb macros  
• SUNWixged.u—adapter driver  
• SUNWixgedu—adapter driver header files  
The optional VLAN packages:  
• SUNWvld—VLAN utility routines  
• SUNWvldx—VLAN utility routines (64-bit, s9)  
• SUNWvldu—VLAN utility headers  
Note – If you intend to use VLAN, you must install VLAN packages when you  
install the software packages.  
3. To use the optional VLAN Utility with the 10-Gigabit Ethernet driver on the  
Solaris 9 Operating System, verify the proper patch revision using the following  
command:  
# showrev -p | grep 114600  
If the patch version is less then 114600-04, update the VLAN Utility software by  
installing the 114600-04 patch.  
50 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
   
4. Install the patch:  
# patchadd 10_GigabitEthernet/Solaris_9/sparc/Patches/114600-04  
5. Check to see if vlandrivers are installed on the system:  
If you are using a Solaris SPARC system:  
# /usr/bin/pkginfo SUNWvld SUNWvldx  
system  
system  
SUNWvld  
SUNWvldx  
Sun Ethernet Vlan Utility Routines  
Sun Ethernet Vlan Utility Routines (64-bit)  
If you do not see the previous output, the VLAN Utility software is not installed  
on your system. You may install the optional VLAN packages if desired in the  
following step.  
If you do see the previous output, do not reinstall the VLAN Utility software.  
Select only the Sun 10 Gigabit Ethernet Driver packages.  
6. Install the software packages by typing the following at the command line,  
replacing the OS_VER with your version of the Solaris operating system:  
If your system is running Solaris 9 or 10 software type the following:  
#/usr/sbin/pkgadd -d  
/cdrom/cdrom0/10_GigabitEthernet/Solaris_OS_VER/ARCH/Packages/  
where OS_VER is 9 or 10 and ARCH is sparc.  
For example, if your system is running the Solaris 9 SPARC operating system, you  
would type the following:  
#/usr/sbin/pkgadd -d  
/cdrom/cdrom0/10_GigabitEthernet/Solaris_9/sparc/Packages/  
Appendix C  
Installing the Software Manually  
51  
 
If your system is running Solaris 9 x86 software type the following:  
#pkgadd -d /Solaris_9/i386/Packages/  
A menu similar to the following displays:  
The following packages are available:  
1 SUNWixgea  
2 SUNWixged.u  
3 SUNWixgedu  
4 SUNWvld  
Sun 10 Gigabit Ethernet Adapter Driver adb Macros  
(sparc) 1.0,REV=2004.12.01.  
Sun 10 Gigabit Ethernet Adapter Driver  
(sparc.sun4u) 1.0,REV=2004.12.01.  
Sun 10 Gigabit Ethernet Adapter Driver Headers  
(sparc) 1.0,REV=2004.12.01.  
Sun Ethernet Vlan Utility Routines  
(sparc) 1.0,REV=2001.09.19.9.0  
5 SUNWvldu  
6 SUNWvldx  
Sun Ethernet Vlan Utility Headers  
(sparc) 1.0,REV=2001.09.19.9.0  
Sun Ethernet Vlan Utility Routines (64-bit)  
(sparc) 1.0,REV=2001.09.19.9.0  
Select package(s) you wish to process (or 'all' to process  
all packages). (default: all) [?,??,q]:  
7. Select the packages you want to install:  
Press Return or type allto accept the default and install all packages (if neither  
the 10-Gigabit Ethernet Driver nor VLAN Utility packages are installed).  
Type the numbers of all but the optional packages if you prefer not to install  
them.  
Note – Do not install VLAN packages if you previously determined that they are  
already present on your system.  
See TABLE C-1 to identify the optional packages.  
52 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
APPENDIX  
D
Installing the Sun 10-Gigabit  
Ethernet Device Driver on Linux  
This appendix explains how to install the Sun 10-Gigabit Ethernet PCI-X device  
driver in a Linux environment. This appendix contains the following sections:  
“Setting Up the Driver in a Linux Platform” on page 53  
“Setting Driver Parameters in a Linux Environment” on page 56  
Setting Up the Driver in a Linux  
Platform  
If your system uses the Linux operating system you will need to perform the  
following procedure to be sure the Sun 10-Gigabit Ethernet device driver is properly  
installed and loaded.  
To Set Up the Driver in a Linux Platform  
1. Build the 10-Gigabit Ethernet driver:  
# rpmbuild --rebuild sun-10-gigabit-kernel-1.0.version.src.rpm  
where the version is the minor version number such as:  
sun-10-gigabit-kernel-1.0.82.6-1.src.rpm  
53  
 
       
2. Build the man pages (optional):  
# rpmbuild --rebuild sun-10-gigabit-1.0.version.src.rpm  
3. Change to the rpmdirectory:  
For RedHat, use the following command:  
# cd /usr/src/redhat/RPMS/arch  
For SuSe Linux Enterprise Server, use the following command:  
# cd /usr/src/packages/RPMS/arch  
4. Install the 10-Gigabit Ethernet rpms, using the same command for both RedHat  
and Suse:  
# rpm -ivh sun-10-gigabit-kernel-1.0.version.arch.rpm  
5. Use the depmodcommand to register the Sun 10-Gigabit Ethernet module:  
# depmod  
6. Load ixgedriver for all instances:  
# modprobe ixge  
54 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
7. Verify that the driver is loaded.  
In the following example, the ixge driver is shown in bold italic. On your  
system the driver will be indistinguishable from the other modules.  
# lsmod  
Module  
ixge  
ide-cd  
ipv6  
key  
st  
sr_mod  
cdrom  
sg  
joydev  
evdev  
Size Used by  
Not tainted  
53592 0 (unused)  
36616 0 (autoclean)  
285176 -1 (autoclean)  
78344 0 (autoclean) [ipv6]  
31380 0 (autoclean) (unused)  
16812 0 (autoclean) (unused)  
34664 0 (autoclean) [ide-cd sr_mod]  
40384 0 (autoclean)  
7136 0 (unused)  
6496 0 (unused)  
input  
7488 0 [joydev evdev]  
23728 0 (unused)  
87648 1 [usb-ohci]  
194456 1  
81248 0 (autoclean)  
248344 1  
44144 2  
46400 3 [mptscsih]  
16192 4  
133028 5 [st sr_mod sg mptscsih sd_mod]  
usb-ohci  
usbcore  
bcm5700  
lvm-mod  
reiserfs  
mptscsih  
mptbase  
sd_mod  
scsi_mod  
8. Run the dmesgcommand to see which devices the ixgedriver was mapped to:  
# dmesg  
10-Gigabit Ethernet Adapter Driver - version 1.0.100.3  
Copyright (c) 1999-2005 Intel Corp., Sun Corp.  
divert: allocating divert_blk for eth2  
eth2: Sun 10-Gigabit Ethernet Adapter Driver  
9. Add the ixgeinterfaces to the /etc/modules.conffile.  
alias eth2 ixge  
alias eth3 ixge  
Appendix D  
Installing the Sun 10-Gigabit Ethernet Device Driver on Linux Platforms  
55  
 
10. Use the ethtoolcommand to check the parameter configurations that apply to  
the ixgedriver.  
# ethtool eth3  
Supported ports: [ FIBRE ]  
Supported link modes:  
Supports auto-negotiation: No  
Advertised link modes: Not reported  
Advertised auto-negotiation: No  
Speed: Unknown! (10000)  
Duplex: Full  
Port: FIBRE  
PHYAD: 0  
Transceiver: externel  
Auto-negotiation: off  
Link detected: yes  
Setting Driver Parameters in a Linux  
Environment  
In a Linux operating system, the driver parameters can only be set at the time the  
driver is loaded. If you have already loaded the driver and have not set the  
parameters at the same time. Remove the driver and reinstall it.  
56 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
 
To Set ixgeParameters in a Linux Environment  
1. Remove the Sun 10-Gigabit Ethernet PCI-X device driver, if it is already loaded.  
# rmmod ixge  
2. Load the Sun 10-Gigabit Ethernet PCI-X device driver:  
# modprobe ixge option=VAL1, VAL2, . . .  
or you can use the insmodcommand:  
# insmod ixge option=VAL1, VAL2, . . .  
where VAL1 applies to the first ixgeinterface and VAL2 to the next interface and so  
on.  
Appendix D  
Installing the Sun 10-Gigabit Ethernet Device Driver on Linux Platforms  
57  
 
 
TABLE D-1 lists the tunable ixgedriver parameters for Linux operating systems, and  
describes their function.  
TABLE D-1 Tunable ixgeDriver Parameters for Linux Operating Systems  
Keyword  
Description  
FlowControl  
Valid Range: 0-3 (0=none, 1=Rx only, 2=Tx only, 3=Rx&Tx)  
Default: Read from the EEPROM  
If EEPROM is not detected, default is 3.  
This parameter controls the automatic generation (Tx) and response  
(Rx) to Ethernet PAUSE frames.  
RxDescriptiors Valid Range: 64-4096  
Default Value: 1024  
This value is the number of receive descriptors allocated by the driver.  
Increasing this value allows the driver to buffer more incoming packets.  
Each descriptor is 16 bytes. A receive buffer is also allocated for each  
descriptor and can be either 2048, 4056, 8192, or 16384 bytes, depending  
on the MTU setting. When the MTU size is 1500 or less, the receive  
buffer size is 2048 bytes. When the MTU is greater than 1500 the receive  
buffer size will be either 4056, 8192, or 16384 bytes. The maximum MTU  
size is 16114.  
RxIntDelay  
Valid Range: 0-65535 (0=off)  
Default Value: 72  
This value delays the generation of receive interrupts in units of 0.8192  
microseconds. Receive interrupt reduction can improve CPU efficiency  
if properly tuned for specific network traffic. Increasing this value adds  
extra latency to frame reception and can end up decreasing the  
throughput of TCP traffic. If the system is reporting dropped receives,  
this value may be set too high, causing the driver to run out of available  
receive descriptors.  
TxDescriptors  
XsumRX  
Valid Range: 64-4096  
Default Value: 256  
This value is the number of transmit descriptors allocated by the driver.  
Increasing this value allows the driver to queue more transmits. Each  
descriptor is 16 bytes.  
Valid Range: 0-1  
Default Value: 1  
A value of 1 indicates that the driver should enable IP checksum offload  
for received packets (both UDP and TCP) to the adapter hardware.  
58 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
 
To Configure VLANs in a Linux Environment  
1. Ensure that the ixgemodule is loaded:  
# modprobe ixge  
2. Plumb the Sun 10-Gigabit Ethernet PCI-X interface:  
# ifconfig eth2 xxx.xxx.xx.xxx up  
where xxx.xxx.xx.xxx = the IP address of the interface.  
3. Insert the vlan module:  
# /sbin/insmod 8021q  
4. Add vlan instance (VID):  
# sbin/vconfig add eth2 5  
5. Configure ixgevlan (eth2in this example):  
# ifconfig eth2.5 xxx.xxx.xx.xxx up  
where xxx.xxx.xx.xxx = the IP address of the interface.  
Appendix D  
Installing the Sun 10-Gigabit Ethernet Device Driver on Linux Platforms  
59  
 
 
To Configure Bonding for Multiple ixge  
Interfaces  
1. Modify /etc/modules.conffile by adding these lines:  
alias bond0 bonding  
options bonding max_bonds=2 mode=4 miimon=1000  
Where:  
bond0is the bonding device.  
max_bondsis the number of bond interfaces to be created.  
modespecifies the bonding policies.  
miimonis the frequency in milliseconds that MII link monitoring will occur.  
Refer to Linux documentation for more information.  
2. Load the bonding driver:  
# modprobe bonding  
3. Configure bond0interface.  
In this example, bond0is the master of the two interfaces eth2and eth3.  
# ip addr add 192.12.38.64/24 brd + dev bond0  
# ip link set dev bond0 up  
# ifenslave bond0 eth2 eth3  
60 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 
 
62  
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005  
 

Sharp Computer Monitor PN K321 User Manual
Shindaiwa Trimmer X7502825100 User Manual
Shure Stereo Amplifier UA830 User Manual
Sonic Impact Technologies CD Player SFT 1 User Manual
Sony DVD Player BDP S270 User Manual
Sony Ericsson Bluetooth Headset HBH 200 User Manual
Speed Queen Clothes Dryer HE4070 User Manual
Star Micronics Printer 8III User Manual
StarTechcom Switch SV221DD User Manual
Sunbeam Blender PB2000 User Manual