Re: [C-bgp-users] a problem about c-bgp in importing as-level topology from caida

[贾溢豪 <yh...@gm...>]

Professor:
      There is one another problem I met with c-bgp, and I really need you
help again.
      After importing data from CAIDA(to simulate the whole Internet), the
command of cbgp: "sim run" haven't finish yet(more than 24h). I notice that
cbgp computes on only one core of CPU at my server, and I'm not sure the
program will successfully complete within the finite or reasonable time.
The attachments scripts are the command I input into cbgp,  and I hope you
could give me some advise on the convergence of the cbgp program.(utilize
all cores of CPU to acceleration?)
     Thank you!
[image: 内嵌图片 1][image: 内嵌图片 2]

2016-06-16 15:57 GMT+08:00 Bruno Quoitin <bru...@um...>:

> Hello,
>
> Yeah, re-mapping is indeed a solution to the 16-bits ASN limit.
> Perhaps you can contribute a remapping script on the mailing-list.
>
> Cheers,
> Bruno
>
>
>
> On 16/06/16 03:32, 贾溢豪 wrote:
>
> Thanks very much for your detailed solution for my problems, I really
> appreciate for your patience in addressing the problems I met. I re-number
> the ASN of all AS to make the topology complete since the total number
> advertised haven't reach 65535 yet.
>
> Thank you again for your kindness!
>
> 2016-06-16 2:31 GMT+08:00 Bruno Quoitin <bru...@um...>:
>
>> Hello,
>>
>> Looks like CAIDA has changed its file format since this parser was
>> implemented in c-bgp (without notifying me ! ;-)). The version used in the
>> regression tests dates back from 2007. Unfortunately, I don't have time to
>> update c-bgp source code in the near future to provide out-of-the-box
>> support for the new file format.
>>
>>
>> However, it might be possible to adapt your input file so that it will be
>> accepted by the current version of c-bgp. There are 3 main issues with the
>> file you sent (20160601.as-rel.txt).
>>
>> 1). Change in delimiter
>>
>> In the former file format, every relationship was encoded as
>>
>>     <ASx> <ASy> <type>
>>
>> With the new format, relationships are encoded as
>>
>>     <ASx> | <ASy> | <type>
>>
>> You can change the delimiter using the following shell code :
>>
>>     awk -F '|' '{print $1" "$2" "$3}' 20160601.as-rel.txt >
>> 20160601.as-rel.oldfmt.txt
>>
>>
>> 2). Too long lines
>>
>> With the new format, some lines have a potentially unbounded length. This
>> is the case for the comment line that provides "# IXP ASes". That line will
>> not be parsed correctly by the current c-bgp "caida parser". You need to
>> remove it. Generally speaking, every line with more than 80 characters will
>> be considered multiple, separate lines and must be removed for the parser
>> to succeed.
>>
>> This can be solved by removing every comment line (i.e. lines starting
>> with '#').
>>
>>     grep -v '^#' 20160601.as-rel.oldfmt.txt >
>> 20160601.as-rel.oldfmt-no-comments.txt
>>
>>
>> 3). 32-bits ASN
>>
>> ASNs higher than 65535 will not be accepted. There is nothing that can be
>> done with these ASNs right now. Relationships involving such ASN need to be
>> removed.
>>
>> It seems 41967 relationships among the 230216 in the file are concerned
>> however...
>>
>>     awk '{if ($1 <= 65535 && $2 <= 65535) print $1" "$2" "$3}'
>> 20160601.as-rel.oldfmt.txt > 20160601.as-rel.oldfmt-16asn.txt
>>
>>
>> Best regards,
>> Bruno
>>
>>
>>
>>
>>
>>
>> On 12/06/16 06:05, 贾溢豪 wrote:
>>
>> Hello, everyone:
>>
>>    I want to use c-bgp to analyze the AS-level topology. But the AS
>> relationship file-"20160601.as-rel.txt" from CAIDA can not be import by
>> command "bgp topology load --format=caida "20160601.as-rel.txt", neither
>> can other files from caida I have tried. Its error message is "could not
>> load topology "as-rel.2011.01.16.txt" (invalid number of parameters, at
>> line 130)".
>>
>>    please help me. Thank you.
>>
>>
>>
>> --
>>
>> Best Regards.
>>
>>
>> *Yihao Jia*
>> Ph.D. Candidate
>> Institute for Network Sciences and Cyberspace
>> Tsinghua University
>>
>>
>> ------------------------------------------------------------------------------
>> What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
>> patterns at an interface-level. Reveals which users, apps, and protocols are
>> consuming the most bandwidth. Provides multi-vendor support for NetFlow,
>> J-Flow, sFlow and other flows. Make informed decisions using capacity planning
>> reports. http://pubads.g.doubleclick.net/gampad/clk?id=1444514421&iu=/41014381
>>
>>
>>
>> _______________________________________________
>> C-bgp-users mailing lis...@li...https://lists.sourceforge.net/lists/listinfo/c-bgp-users
>>
>>
>>
>
>
> --
>
> Best Regards.
>
>
> *Yihao Jia(贾溢豪)*
> Ph.D. Candidate
> Institute for Network Sciences and Cyberspace
> Tsinghua University
> Beijing , China. 100084
>
> (Room 4-204, FIT Building of Tsinghua University)
>
>
>


-- 

Best Regards.


*Yihao Jia(贾溢豪)*

Ph.D. Candidate
Institute for Network Sciences and Cyberspace
Tsinghua University
Beijing , China. 100084

(Room 4-204, FIT Building of Tsinghua University)