Menu
▾
▴
Re: [E1000-devel] issue in igb driver : Observing high value in rx_missed_errors & rx_no_buffer_count ( in Linux kernel 2.6)
|
From: Baskar D. <bas...@gm...> - 2011-07-25 19:30:24
|
Brandeburg, Jesse <jesse.brandeburg <at> intel.com> writes: > > standard questions, what exact kernel, what igb driver version, what does cat /proc/interrupts look > like, are you running msi-x in 2.6 kernel? > > is it the in-kernel version? > > if so you're running NAPI for sure, and NAPI pushes the packet drops back down to the hardware device when the > stack/cpu cannot keep up. This is by design. see the NAPI paper by Robert Olsson and Jamal Hadi. > > figuring out why your stack cannot keep up would be a good first step. What application is receiving the > packets? Have you tried increasing net.core.rmem_default and net.core.rmem_max with sysctl? > > -----Original Message----- > From: Raghukrishna Hegde [mailto:rkhegde <at> juniper.net] > Sent: Thursday, February 26, 2009 4:19 AM > To: Naveen Chandra M J; e1000-devel <at> lists.sourceforge.net > Cc: Puneet Tutliani; Arindam Chatterjee > Subject: Re: [E1000-devel] issue in igb driver : Observing high value in rx_missed_errors & > rx_no_buffer_count ( in Linux kernel 2.6) > > Naveen, > > It seems you have not attached the register dump > > --raghu. > > ________________________________ > > From: Naveen Chandra M J > Sent: Thursday, February 26, 2009 5:35 PM > To: 'e1000-devel <at> lists.sourceforge.net' > Cc: Arindam Chatterjee; Puneet Tutliani; Raghukrishna Hegde > Subject: issue in igb driver : Observing high value in rx_missed_errors > & rx_no_buffer_count ( in Linux kernel 2.6) > > Hi All, > > We are running the igb driver in 2.6 kernel (running in polling mode > and PBA is 34K) for the Nic Card "Intel Corporation 82575EB Gigabit > Network Ethernet controller (-rev 02).".But we are seeing some problem > in increasing "rx_no_buffer_count (RNBC)" and "rx_missed_errors (MPC)" > values when we send UDP traffic with 200k to 300k PPS and packet size is > 256 or 512. We are seeing high numbers in rx_missed_errors and very > small numbers in rx_no_buffer_count. > > But we are not facing > such problem when we run the same driver in Linux 2.4 for the Nic Card > "Intel Corporation 82575EB Gigabit Network Ethernet controller (-rev > 02)". > > Here is the ethtool dump for particular interface during test: (Driver: > igb and Kernel 2.6) > > ethtool -S eth8 > > NIC statistics: > > rx_packets: 23352919184 > > tx_packets: 0 > > rx_bytes: 5978344567552 > > tx_bytes: 0 > > rx_broadcast: 0 > > tx_broadcast: 0 > > rx_multicast: 0 > > tx_multicast: 0 > > rx_errors: 0 > > tx_errors: 0 > > tx_dropped: 0 > > multicast: 0 > > collisions: 0 > > rx_length_errors: 0 > > rx_over_errors: 0 > > rx_crc_errors: 0 > > rx_frame_errors: 0 > > rx_no_buffer_count: 975831 > > rx_missed_errors: 3019559561 > > tx_aborted_errors: 0 > > tx_carrier_errors: 0 > > tx_fifo_errors: 0 > > tx_heartbeat_errors: 0 > > tx_window_errors: 0 > > tx_abort_late_coll: 0 > > tx_deferred_ok: 0 > > tx_single_coll_ok: 0 > > tx_multi_coll_ok: 0 > > tx_timeout_count: 0 > > tx_restart_queue: 0 > > rx_long_length_errors: 0 > > rx_short_length_errors: 0 > > rx_align_errors: 0 > > tx_tcp_seg_good: 0 > > tx_tcp_seg_failed: 0 > > rx_flow_control_xon: 0 > > rx_flow_control_xoff: 0 > > tx_flow_control_xon: 0 > > tx_flow_control_xoff: 0 > > rx_long_byte_count: 5978344567552 > > rx_csum_offload_good: 23352918900 > > rx_csum_offload_errors: 0 > > rx_header_split: 0 > > alloc_rx_buff_failed: 0 > > tx_smbus: 0 > > rx_smbus: 0 > > dropped_smbus: 0 > > I am also attaching the register dump value for particular interface: > > 1. " RegisterDumpForIgbDriverOfKernel2.6.txt " : Which provides > register dump value for the particular interface in the igb driver ( > we are facing problem in > this driver , which is running in polling mode) --- Here Linux kernel > is 2.6 .24 > > 2. "RegisterDumpForIgbDriverOfKernel2.4.txt" : Which provides register > dump values for the particular interface in the IGB driver (Working fine > and running in NAPI mode ) - --Here the Linux Kernel is 2.4 ,this is > for reference > > We are seeing some difference in register value on both Register > dump. I have listed some register names where we see different values in > both Register dump > > #define E1000_CTRL 0x00000 /* Device Control - RW */ > > #define E1000_CTRL_DUP 0x00004 /* Device Control Duplicate (Shadow) - > RW */ > > #define E1000_STATUS 0x00008 /* Device Status - RO */ > > #define E1000_EECD 0x00010 /* EEPROM/Flash Control - RW */ > > #define E1000_MDIC 0x00020 /* MDI Control - RW */ > > #define E1000_FEXTNVM 0x00028 and #define E1000_FCAL 0x00028 /* Flow > Control Address Low - RW */ and /* Future Extended NVM - RW */ > > #define E1000_CONNSW 0x00034 /* Copper/Fiber switch control - RW */ > > #define E1000_ITR 0x000C4 /* Interrupt Throttling Rate - RW */ > > #define E1000_TCTL_EXT 0x00404 /* Extended TX Control - RW */ > > #define E1000_TIPG 0x00410 /* TX Inter-packet gap -RW */ > > #define E1000_TBT 0x00448 /* TX Burst Timer - RW */ > > #define E1000_AIT 0x00458 /* Adaptive Interframe Spacing Throttle > - RW */ > > Actually we wanted to know which of these registers can act as a tunable > knob in overcoming the rx_missed_errors and rx_no_buffer count issue. > > Thanks & Regards, > > Naveen Chandra MJ > > Regards, > > Naveen Chandra MJ > > ------------------------------------------------------------------------------ > Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA > -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise > -Strategies to boost innovation and cut costs with open source participation > -Receive a $600 discount off the registration fee with the source code: SFAD > http://p.sf.net/sfu/XcvMzF8H > Hello - I am experiencing similar problem. We are using Intel 82572EI card with e1000e driver. ethtool is reporting the errors as rx_missed_errors. netstat is reporting them as RX_OVR error. We are using 2.6.18.238 kernel and driver version is 1.2.7-k2. Could you please let me know have you resolved the issue? and what resolved the issue? /home/user> /sbin/ethtool -i eth2 driver: e1000e version: 1.2.7-k2 firmware-version: 5.6-9 bus-info: 0000:04:00.0 eth2 Link encap:Ethernet HWaddr XX:XX:XX:XX:XX inet addr:10.10.10.10 Bcast:10.10.XX.XX Mask:255.255.255.252 inet6 addr: XXXX::XXX:Xxx/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:6480824850 errors:0 dropped:731158 overruns:0 frame:0 TX packets:507808672 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:1391098513861 (1.2 TiB) TX bytes:113540706854 (105.7 GiB) Interrupt:169 Memory:df1c0000-df1e0000 /home/user> /sbin/ethtool -S eth2 NIC statistics: rx_packets: 6486415530 tx_packets: 508134017 rx_bytes: 1418244192469 tx_bytes: 115647228056 rx_broadcast: 0 tx_broadcast: 869 rx_multicast: 5 tx_multicast: 40 rx_errors: 0 tx_errors: 0 tx_dropped: 0 multicast: 5 collisions: 0 rx_length_errors: 0 rx_over_errors: 0 rx_crc_errors: 0 rx_frame_errors: 0 rx_no_buffer_count: 2132431 rx_missed_errors: 731158 tx_aborted_errors: 0 tx_carrier_errors: 0 tx_fifo_errors: 0 tx_heartbeat_errors: 0 tx_window_errors: 0 tx_abort_late_coll: 0 tx_deferred_ok: 0 tx_single_coll_ok: 0 tx_multi_coll_ok: 0 tx_timeout_count: 0 tx_restart_queue: 0 rx_long_length_errors: 0 rx_short_length_errors: 0 rx_align_errors: 0 tx_tcp_seg_good: 0 tx_tcp_seg_failed: 0 rx_flow_control_xon: 0 rx_flow_control_xoff: 0 tx_flow_control_xon: 17871 tx_flow_control_xoff: 747787 rx_long_byte_count: 1418244192469 rx_csum_offload_good: 6486403980 rx_csum_offload_errors: 0 rx_header_split: 0 alloc_rx_buff_failed: 0 tx_smbus: 0 rx_smbus: 0 dropped_smbus: 0 rx_dma_failed: 0 tx_dma_failed: 0 Thanks Baskar |