Re: [C-bgp-users] a problem about c-bgp in importing as-level topology from caida

[贾溢豪 <yh...@gm...>]

The topo I use is attached in attachment. : )

2016-06-28 16:54 GMT+08:00 贾溢豪 <yh...@gm...>:

> Professor:
>       There is one another problem I met with c-bgp, and I really need you
> help again.
>       After importing data from CAIDA(to simulate the whole Internet), the
> command of cbgp: "sim run" haven't finish yet(more than 24h). I notice that
> cbgp computes on only one core of CPU at my server, and I'm not sure the
> program will successfully complete within the finite or reasonable time.
> The attachments scripts are the command I input into cbgp,  and I hope you
> could give me some advise on the convergence of the cbgp program.(utilize
> all cores of CPU to acceleration?)
>      Thank you!
> [image: 内嵌图片 1][image: 内嵌图片 2]
>
> 2016-06-16 15:57 GMT+08:00 Bruno Quoitin <bru...@um...>:
>
>> Hello,
>>
>> Yeah, re-mapping is indeed a solution to the 16-bits ASN limit.
>> Perhaps you can contribute a remapping script on the mailing-list.
>>
>> Cheers,
>> Bruno
>>
>>
>>
>> On 16/06/16 03:32, 贾溢豪 wrote:
>>
>> Thanks very much for your detailed solution for my problems, I really
>> appreciate for your patience in addressing the problems I met. I re-number
>> the ASN of all AS to make the topology complete since the total number
>> advertised haven't reach 65535 yet.
>>
>> Thank you again for your kindness!
>>
>> 2016-06-16 2:31 GMT+08:00 Bruno Quoitin <bru...@um...>:
>>
>>> Hello,
>>>
>>> Looks like CAIDA has changed its file format since this parser was
>>> implemented in c-bgp (without notifying me ! ;-)). The version used in the
>>> regression tests dates back from 2007. Unfortunately, I don't have time to
>>> update c-bgp source code in the near future to provide out-of-the-box
>>> support for the new file format.
>>>
>>>
>>> However, it might be possible to adapt your input file so that it will
>>> be accepted by the current version of c-bgp. There are 3 main issues with
>>> the file you sent (20160601.as-rel.txt).
>>>
>>> 1). Change in delimiter
>>>
>>> In the former file format, every relationship was encoded as
>>>
>>>     <ASx> <ASy> <type>
>>>
>>> With the new format, relationships are encoded as
>>>
>>>     <ASx> | <ASy> | <type>
>>>
>>> You can change the delimiter using the following shell code :
>>>
>>>     awk -F '|' '{print $1" "$2" "$3}' 20160601.as-rel.txt >
>>> 20160601.as-rel.oldfmt.txt
>>>
>>>
>>> 2). Too long lines
>>>
>>> With the new format, some lines have a potentially unbounded length.
>>> This is the case for the comment line that provides "# IXP ASes". That line
>>> will not be parsed correctly by the current c-bgp "caida parser". You need
>>> to remove it. Generally speaking, every line with more than 80 characters
>>> will be considered multiple, separate lines and must be removed for the
>>> parser to succeed.
>>>
>>> This can be solved by removing every comment line (i.e. lines starting
>>> with '#').
>>>
>>>     grep -v '^#' 20160601.as-rel.oldfmt.txt >
>>> 20160601.as-rel.oldfmt-no-comments.txt
>>>
>>>
>>> 3). 32-bits ASN
>>>
>>> ASNs higher than 65535 will not be accepted. There is nothing that can
>>> be done with these ASNs right now. Relationships involving such ASN need to
>>> be removed.
>>>
>>> It seems 41967 relationships among the 230216 in the file are concerned
>>> however...
>>>
>>>     awk '{if ($1 <= 65535 && $2 <= 65535) print $1" "$2" "$3}'
>>> 20160601.as-rel.oldfmt.txt > 20160601.as-rel.oldfmt-16asn.txt
>>>
>>>
>>> Best regards,
>>> Bruno
>>>
>>>
>>>
>>>
>>>
>>>
>>> On 12/06/16 06:05, 贾溢豪 wrote:
>>>
>>> Hello, everyone:
>>>
>>>    I want to use c-bgp to analyze the AS-level topology. But the AS
>>> relationship file-"20160601.as-rel.txt" from CAIDA can not be import by
>>> command "bgp topology load --format=caida "20160601.as-rel.txt", neither
>>> can other files from caida I have tried. Its error message is "could not
>>> load topology "as-rel.2011.01.16.txt" (invalid number of parameters, at
>>> line 130)".
>>>
>>>    please help me. Thank you.
>>>
>>>
>>>
>>> --
>>>
>>> Best Regards.
>>>
>>>
>>> *Yihao Jia*
>>> Ph.D. Candidate
>>> Institute for Network Sciences and Cyberspace
>>> Tsinghua University
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
>>> patterns at an interface-level. Reveals which users, apps, and protocols are
>>> consuming the most bandwidth. Provides multi-vendor support for NetFlow,
>>> J-Flow, sFlow and other flows. Make informed decisions using capacity planning
>>> reports. http://pubads.g.doubleclick.net/gampad/clk?id=1444514421&iu=/41014381
>>>
>>>
>>>
>>> _______________________________________________
>>> C-bgp-users mailing lis...@li...https://lists.sourceforge.net/lists/listinfo/c-bgp-users
>>>
>>>
>>>
>>
>>
>> --
>>
>> Best Regards.
>>
>>
>> *Yihao Jia(贾溢豪)*
>> Ph.D. Candidate
>> Institute for Network Sciences and Cyberspace
>> Tsinghua University
>> Beijing , China. 100084
>>
>> (Room 4-204, FIT Building of Tsinghua University)
>>
>>
>>
>
>
> --
>
> Best Regards.
>
>
> *Yihao Jia(贾溢豪)*
>
> Ph.D. Candidate
> Institute for Network Sciences and Cyberspace
> Tsinghua University
> Beijing , China. 100084
>
> (Room 4-204, FIT Building of Tsinghua University)
>



-- 

Best Regards.


*Yihao Jia(贾溢豪)*

Ph.D. Candidate
Institute for Network Sciences and Cyberspace
Tsinghua University
Beijing , China. 100084

(Room 4-204, FIT Building of Tsinghua University)