Re: [como-devel] Como at 10Gbit/s

[Oana G. <oan...@en...>]

Hello,

Thank you for your answer.

Do you plan to adapt some changes in the new version of Como in order  
to support traffic captures at 10Gbit/s?

Thanks,
Oana

Quoting "Iannaccone, Gianluca" <gia...@in...>:

> Hi Oana,
>
> the trace module makes a copy of each packet (with the snaplen  
> parameters you can set how many bytes per packet to keep) and then  
> writes them to disk (with a second copy). This is a restriction of  
> our design that forces one more memory copy. Your tweaks are good  
> ones but I am not sure how to improve from there without major  
> changes in the core (e.g., the code right makes very poor use of  
> multicore)
>
> cheers,
> gianluca
>
>
>
> From: Oana Goga [mailto:oan...@en...]
> Sent: Monday, August 31, 2009 1:21 PM
> To: com...@li...
> Subject: [como-devel] Como at 10Gbit/s
>
> Hello,
>
> Lately I have been working on a driver for GtrcNET-10 box. Device  
> that is able to capture traffic from 10Gbit/s links by capturing all  
> the packets headers and sending them in datagrams that contain  
> multiple headers to a collector machine.
> For testing it I used como v1.5 and it is able to run for 10Gbit/s  
> traffic on the link without loss (or very little ones) for the  
> majority of the modules.
> But not for the trace module, if I am sending traffic with a speed  
> of more than 1Gbit/s I am getting this warnings and errors:
>
> [66833.915407 ca] sorry out of memory for 400048 bytes  
> (/home/lyon/ogoga/como-1.5/base/capture.c:168)!
> [66833.915409 ca] out of memory for trace, skipping pkt
> [66833.915412 ca] sorry out of memory for 400048 bytes  
> (/home/lyon/ogoga/como-1.5/base/capture.c:168)!
> [66833.915415 ca] out of memory for trace, skipping pkt
> [66834.040731 su] WARNING!! CAPTURE (pid 18653) terminated (signal:  
> 6) mdl 4/4
> [66834.027094 ex] error on IPC handle from 8 (-1)
> - up 0d00h03m21s; mem 750/289/1023/2048MB (579); pkts 2641262 drops  
> 0; mdl 4/4
> or
> [65763.171187 ca] sorry out of memory for 4000048 bytes  
> (/home/lyon/ogoga/como-1.5/base/capture.c:168)!
> [65763.171190 ca] out of memory for tuple, skipping pkt               
>          4
> [65763.171193 ca] sorry out of memory for 104 bytes  
> (/home/lyon/ogoga/como-1.5/base/memory.c:459)!
> [65763.171196 ca] sorry out of memory for 4000048 bytes  
> (/home/lyon/ogoga/como-1.5/base/capture.c:168)!
> [65763.171200 ca] out of memory for tuple, skipping pkt               
>          4
> [65763.171204 ca] sorry out of memory for 20 bytes  
> (/home/lyon/ogoga/como-1.5/base/capture.c:242)!
> [65763.264745 ex] error on IPC handle from 8 (-1)                     
>          4
> - up 0d01h59m41s; mem 868/334/982/2048MB (698); pkts 534161124 drops  
> 0; mdl 4/4
>
> after I tried to do some tweaking: I put the flush interval from  
> capture.c at 10 microseconds, the  POLL_WAIT  at 10 and the maximum  
> number of packets in the sniffer at 6200, the error was this:
>
> [72579.970915 ca] flexible flush for trace occurred                   
>          dl 1/1
> [72579.970915 ca] flexible flush for trace occurred                   
>          l 1/11
>     -- Last message repeated 340 times.
> [72583.388661 ca] sorry out of memory for 2068 bytes  
> (/home/lyon/ogoga/como-1.5/base/capture.c:437)!
> [72583.388661 ca] sorry out of memory for 2068 bytes  
> (/home/lyon/ogoga/como-1.5/base/capture.c:437)!
>     -- Last message repeated 65106 times.
> [72583.525725 ca] flexible flush for trace occurred                   
>          dl 1/1
> - up 0d00h01m51s; mem 1919/942/2047/2048MB (450119); pkts 16329064  
> drops 0; mdl 1/11
> while sending traffic at 2Gbit/s.
>
> and link this with traffic at around 10Gbit/s:
>
> [72814.439422 ca] flexible flush for trace occurred                   
>          15; mdl 1/1
> [72814.441319 ca] sorry out of memory for 2068 bytes  
> (/home/lyon/ogoga/como-1.5/base/capture.c:437)!
> [72814.441319 ca] sorry out of memory for 2068 bytes  
> (/home/lyon/ogoga/como-1.5/base/capture.c:437)!
>     -- Last message repeated 6199 times.
> [72814.482128 ca] flexible flush for trace occurred                   
>          15; mdl 1/1
> [72814.483788 ca] sorry out of memory for 2068 bytes  
> (/home/lyon/ogoga/como-1.5/base/capture.c:437)!
> [72814.483788 ca] sorry out of memory for 2068 bytes  
> (/home/lyon/ogoga/como-1.5/base/capture.c:437)!
>     -- Last message repeated 6199 times.
> [72814.522719 ca] flexible flush for trace occurred                   
>          15; mdl 1/1
> [72814.524799 ca] sorry out of memory for 2068 bytes  
> (/home/lyon/ogoga/como-1.5/base/capture.c:437)!
> - up 0d00h05m59s; mem 0/0/2047/2048MB (0); pkts 54098100 drops  
> 440615; mdl 1/1
> in this case the system is not crushing, but it's not storing many  
> packets either.
>
> In the como.conf the memory field is 2048 (I modified in memory.c so  
> I can address it).
>
> Do you know what other tweaking could I make in order to be able to  
> capture more?
>
> Do you plan to make como compilable on 64bits or make some  
> structures that are able to allocate more than 2GB of memory?
>
> The system on which I am working has 8GB RAM and was previously  
> tested with MAPI to capture traffic from 10Gbit/s links and it was  
> working without loss.
>
> Thanks,
> Oana
>
>
>
>
>
>