openpacket-devel

[Openpacket-devel] Just uploaded some torrents

[David J. B. <da...@vo...>]

I just uploaded some torrent files to OpenPacket.  One is the Shmoocon 2007
torrent that has been up on the tracker for a while now.  There are also
three new torrents for packet captures from Defcon 8, 9 and 11.  The Defcon
12 torrent is having a few issues, which I hope to have ironed out soon.

I did these as torrents because the packet captures are very large.  I
think the smallest is about 5GB. I uploaded them the same way I would
upload a PCAP file, and they're all tagged as "torrent".  However, the
data contained in these captures doesn't really fall easily into the standard
"Normal/Suspicious/Malicious" category we use in OP.  I would like to request
a new category, just for torrents.  This should make it easier for people
who need to find large captures to use as a corpus of test data or something.

For something slightly more difficult, it'd be kinda nice to embed the
tracker stats for each torrent inside the OP interface.  For example,
before you download the torrent, it could show you the current # of
seeds and peers.  This is kind of standard on web sites that host torrents.

I think we're going to collect more and more large captures via bittorrent
in the future, so some basic support inside OP would be great.

Oh, and please seed these!  I'm the only one seeding the Defcon captures
right now.  Looks like I might need a new HD just to store these on at
some point.

	David

Re: [Openpacket-devel] Just uploaded some torrents

[Richard B. <tao...@gm...>]

On Mon, Jun 2, 2008 at 9:16 AM, David J. Bianco <da...@vo...> wrote:
> I just uploaded some torrent files to OpenPacket.  One is the Shmoocon 2007
> torrent that has been up on the tracker for a while now.  There are also
> three new torrents for packet captures from Defcon 8, 9 and 11.  The Defcon
> 12 torrent is having a few issues, which I hope to have ironed out soon.
>
> I did these as torrents because the packet captures are very large.  I
> think the smallest is about 5GB. I uploaded them the same way I would
> upload a PCAP file, and they're all tagged as "torrent".  However, the
> data contained in these captures doesn't really fall easily into the standard
> "Normal/Suspicious/Malicious" category we use in OP.  I would like to request
> a new category, just for torrents.  This should make it easier for people
> who need to find large captures to use as a corpus of test data or something.
>
> For something slightly more difficult, it'd be kinda nice to embed the
> tracker stats for each torrent inside the OP interface.  For example,
> before you download the torrent, it could show you the current # of
> seeds and peers.  This is kind of standard on web sites that host torrents.
>
> I think we're going to collect more and more large captures via bittorrent
> in the future, so some basic support inside OP would be great.
>
> Oh, and please seed these!  I'm the only one seeding the Defcon captures
> right now.  Looks like I might need a new HD just to store these on at
> some point.
>
>        David
>

David, great work.

Sharri, what do you think about making the site more torrent-friendly?

Thank you,

Richard

Re: [Openpacket-devel] Just uploaded some torrents

[Sharri P. <sh...@gm...>]

> Sharri, what do you think about making the site more torrent-friendly?

sure thing. so in a nutshell, add a new category.

>> For something slightly more difficult, it'd be kinda nice to embed the
>> tracker stats for each torrent inside the OP interface.  For example,
>> before you download the torrent, it could show you the current # of
>> seeds and peers.  This is kind of standard on web sites that host torrents.

i need these points explained in more detail. we're talking about
particular captures that are too large to say upload and store on OP
but instead just host the .torrent files?

Re: [Openpacket-devel] Just uploaded some torrents

[David J. B. <da...@vo...>]

Sharri Parsell wrote:
>> Sharri, what do you think about making the site more torrent-friendly?
> 
> sure thing. so in a nutshell, add a new category.

Yeah.  I'm not exactly sure what to call it, though.  Maybe just "other"
would be good.


> 
>>> For something slightly more difficult, it'd be kinda nice to embed the
>>> tracker stats for each torrent inside the OP interface.  For example,
>>> before you download the torrent, it could show you the current # of
>>> seeds and peers.  This is kind of standard on web sites that host torrents.
> 
> i need these points explained in more detail. we're talking about
> particular captures that are too large to say upload and store on OP
> but instead just host the .torrent files?

Exactly.  In fact, not only are they often too large to host, they're
often too large to download efficiently from a single site.  So people
use BitTorrent to download many pieces of the data from different sources
simultaneously.  Those different sources are actually just other BitTorrent
users, so as you're downloading pieces, you're also uploading them to
other downloaders, and you are what is known as a "peer".  Users who have a
complete copy of all the data in the torrent are known as "seeds".  By
having one or more seeds in the torrent, you guarantee that at least one
copy of each piece of data is available, which is another way of saying
that you're not wasting your time on a download which will never complete.

So BitTorrent speed depends upon the number of peers and seeds which are
participating in a given torrent, which is why it's useful to list those
up front.  No point downloading 15.999GB, only to find that the last piece
you need to complete the download is not available because there are no
seeds.

You can see this in action if you go to a bittorrent tracker like
ThePirateBay.org and search some torrents.  They'll show you the relevant
stats before you download the torrent, so you'll know what to expect.
JJ can probably help you get this info from the tracker somehow, as it's
his tracker.

	David

Re: [Openpacket-devel] Just uploaded some torrents

[Richard B. <tao...@gm...>]

On Tue, Jun 3, 2008 at 8:21 PM, Richard Bejtlich <tao...@gm...> wrote:
> On Mon, Jun 2, 2008 at 9:16 AM, David J. Bianco <da...@vo...> wrote:
>> I just uploaded some torrent files to OpenPacket.

Hi David,

I just tried

https://www.openpacket.org/uploads/0000/0039/OpenPacket_Defcon12_Captures.torrent

and it appears to be invalid.  Would you mind checking them again?

Someone in the Forum pointed this out.

Thank you,

Richard

Re: [Openpacket-devel] Just uploaded some torrents

[Leon W. <leo...@so...>]

Hi.

I Also have problems with these torrents.
I have tried 11 and 12, both with the same result.

lward@beetle:/var/tmp$ btdownloadcurses.bittornado ./ 
OpenPacket_Defcon12_Captures.torrent
These errors occurred during execution:
[09:04:09] warning: bad data in responsefile
[09:04:09] got bad file info - bad bencoded data
lward@beetle:/var/tmp$

-Leon


On 4 Jun 2008, at 03:54, Richard Bejtlich wrote:

> On Tue, Jun 3, 2008 at 8:21 PM, Richard Bejtlich <tao...@gm... 
> > wrote:
>> On Mon, Jun 2, 2008 at 9:16 AM, David J. Bianco <da...@vo...>  
>> wrote:
>>> I just uploaded some torrent files to OpenPacket.
>
> Hi David,
>
> I just tried
>
> https://www.openpacket.org/uploads/0000/0039/OpenPacket_Defcon12_Captures.torrent
>
> and it appears to be invalid.  Would you mind checking them again?
>
> Someone in the Forum pointed this out.
>
> Thank you,
>
> Richard
>
> -------------------------------------------------------------------------
> Check out the new SourceForge.net Marketplace.
> It's the best place to buy or sell services for
> just about anything Open Source.
> http://sourceforge.net/services/buy/index.php
> _______________________________________________
> Openpacket-devel mailing list
> Ope...@li...
> https://lists.sourceforge.net/lists/listinfo/openpacket-devel

Re: [Openpacket-devel] Just uploaded some torrents

[David J. B. <da...@vo...>]

Yeah, sorry about that.  They were correct on the tracker, but the
copies of the torrent files I uploaded through OP were corrupt.  I
figured it all out, though, and corrected the bad files.  Download new
copies, and all should be well.

Sorry about that.

	David

Richard Bejtlich wrote:
> On Tue, Jun 3, 2008 at 8:21 PM, Richard Bejtlich <tao...@gm...> wrote:
>> On Mon, Jun 2, 2008 at 9:16 AM, David J. Bianco <da...@vo...> wrote:
>>> I just uploaded some torrent files to OpenPacket.
> 
> Hi David,
> 
> I just tried
> 
> https://www.openpacket.org/uploads/0000/0039/OpenPacket_Defcon12_Captures.torrent
> 
> and it appears to be invalid.  Would you mind checking them again?
> 
> Someone in the Forum pointed this out.
> 
> Thank you,
> 
> Richard