[como-devel] Como at 10Gbit/s

[Oana G. <oan...@en...>]

Hello,

Lately I have been working on a driver for GtrcNET-10 box. Device that 
is able to capture traffic from 10Gbit/s links by capturing all the 
packets headers and sending them in datagrams that contain multiple 
headers to a collector machine.
For testing it I used como v1.5 and it is able to run for 10Gbit/s 
traffic on the link without loss (or very little ones) for the majority 
of the modules.
But not for the trace module, if I am sending traffic with a speed of 
more than 1Gbit/s I am getting this warnings and errors:

[66833.915407 ca] sorry out of memory for 400048 bytes 
(/home/lyon/ogoga/como-1.5/base/capture.c:168)!
[66833.915409 ca] out of memory for trace, skipping pkt
[66833.915412 ca] sorry out of memory for 400048 bytes 
(/home/lyon/ogoga/como-1.5/base/capture.c:168)!
[66833.915415 ca] out of memory for trace, skipping pkt
[66834.040731 su] WARNING!! CAPTURE (pid 18653) terminated (signal: 6) 
mdl 4/4
[66834.027094 ex] error on IPC handle from 8 (-1)
- up 0d00h03m21s; mem 750/289/1023/2048MB (579); pkts 2641262 drops 0; 
mdl 4/4
or
[65763.171187 ca] sorry out of memory for 4000048 bytes 
(/home/lyon/ogoga/como-1.5/base/capture.c:168)!
[65763.171190 ca] out of memory for tuple, skipping 
pkt                       4
[65763.171193 ca] sorry out of memory for 104 bytes 
(/home/lyon/ogoga/como-1.5/base/memory.c:459)!
[65763.171196 ca] sorry out of memory for 4000048 bytes 
(/home/lyon/ogoga/como-1.5/base/capture.c:168)!
[65763.171200 ca] out of memory for tuple, skipping 
pkt                       4
[65763.171204 ca] sorry out of memory for 20 bytes 
(/home/lyon/ogoga/como-1.5/base/capture.c:242)!
[65763.264745 ex] error on IPC handle from 8 (-1) * 
*                         4
- up 0d01h59m41s; mem 868/334/982/2048MB (698); pkts 534161124 drops 0; 
mdl 4/4

after I tried to do some tweaking: I put the flush interval from 
capture.c at 10 microseconds, the  POLL_WAIT  at 10 and the maximum 
number of packets in the sniffer at 6200, the error was this:

[72579.970915 ca] flexible flush for trace 
occurred                           dl 1/1
[72579.970915 ca] flexible flush for trace 
occurred                           l 1/11
     -- Last message repeated 340 times.
[72583.388661 ca] sorry out of memory for 2068 bytes 
(/home/lyon/ogoga/como-1.5/base/capture.c:437)!
[72583.388661 ca] sorry out of memory for 2068 bytes 
(/home/lyon/ogoga/como-1.5/base/capture.c:437)!
     -- Last message repeated 65106 times.
[72583.525725 ca] flexible flush for trace 
occurred                           dl 1/1
- up 0d00h01m51s; mem 1919/942/2047/2048MB (450119); pkts 16329064 drops 
0; mdl 1/11
while sending traffic at 2Gbit/s.

and link this with traffic at around 10Gbit/s:

[72814.439422 ca] flexible flush for trace 
occurred                           15; mdl 1/1
[72814.441319 ca] sorry out of memory for 2068 bytes 
(/home/lyon/ogoga/como-1.5/base/capture.c:437)!
[72814.441319 ca] sorry out of memory for 2068 bytes 
(/home/lyon/ogoga/como-1.5/base/capture.c:437)!
     -- Last message repeated 6199 times.
[72814.482128 ca] flexible flush for trace 
occurred                           15; mdl 1/1
[72814.483788 ca] sorry out of memory for 2068 bytes 
(/home/lyon/ogoga/como-1.5/base/capture.c:437)!
[72814.483788 ca] sorry out of memory for 2068 bytes 
(/home/lyon/ogoga/como-1.5/base/capture.c:437)!
     -- Last message repeated 6199 times.
[72814.522719 ca] flexible flush for trace 
occurred                           15; mdl 1/1
[72814.524799 ca] sorry out of memory for 2068 bytes 
(/home/lyon/ogoga/como-1.5/base/capture.c:437)!
- up 0d00h05m59s; mem 0/0/2047/2048MB (0); pkts 54098100 drops 440615; 
mdl 1/1
in this case the system is not crushing, but it's not storing many 
packets either.

In the como.conf the memory field is 2048 (I modified in memory.c so I 
can address it).

Do you know what other tweaking could I make in order to be able to 
capture more?

Do you plan to make como compilable on 64bits or make some structures 
that are able to allocate more than 2GB of memory?

The system on which I am working has 8GB RAM and was previously tested 
with MAPI to capture traffic from 10Gbit/s links and it was working 
without loss.

Thanks,
Oana