openpacket-devel

[Openpacket-devel] Bulk PCAP files upload

[David A. Belle-I. <ml...@im...>]

Hi everyone,

We decided to have the option to be able to upload a large number of 
files at the same time (bulk upload) to the trace files repository. 
(Additionally to the option of uploading one file at a time)

The problem is that I can't figure out a way to do it! If you have an 
idea or if you have already done that I would like to know it and have 
some details of how this could be possible.

So far I developped the project in python using the django web 
development framework.

If you need any additional info let me know, I'll post what you need.

Thanks a lot,

David

Re: [Openpacket-devel] Bulk PCAP files upload

[David A. Belle-I. <ml...@im...>]

Hi Jacob,

Thanks for the input.

I agree with you if we needed to upload a couple of files at the 
sametime but we are talking about thousands of files here. I doubt the 
user would be interested in clicking "Browse..." a thousand time! :)

Thanks,

David



Jacob Ham wrote:
> Either through the use of ajax, just some javascript, it could
> automatically add another file field after they have selected a file
> to be uploaded.  When they have finished, just add these to a file
> table.  There would have to be many-to-many relationship to this file
> table from the trace table.  Then it would be possible for a trace to
> have many capture files.
> 
> If you need me to elaborate more, please let me know.
> 
> Jake
> 
> On 7/28/06, David A. Belle-Isle <ml...@im...> wrote:
>> Hi everyone,
>>
>> We decided to have the option to be able to upload a large number of
>> files at the same time (bulk upload) to the trace files repository.
>> (Additionally to the option of uploading one file at a time)
>>
>> The problem is that I can't figure out a way to do it! If you have an
>> idea or if you have already done that I would like to know it and have
>> some details of how this could be possible.
>>
>> So far I developped the project in python using the django web
>> development framework.
>>
>> If you need any additional info let me know, I'll post what you need.
>>
>> Thanks a lot,
>>
>> David
>>
>>
>>
>> -------------------------------------------------------------------------
>> Take Surveys. Earn Cash. Influence the Future of IT
>> Join SourceForge.net's Techsay panel and you'll get the chance to 
>> share your
>> opinions on IT & business topics through brief surveys -- and earn cash
>> http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
>> _______________________________________________
>> Openpacket-devel mailing list
>> Ope...@li...
>> https://lists.sourceforge.net/lists/listinfo/openpacket-devel
>>
> 

[Openpacket-devel] Fwd: Bulk PCAP files upload

[Tim F. <fu...@cc...>]

Resent from the correct email address (again). :P

---------- Forwarded message ----------
From: Tim Furlong <tim...@gm...>
Date: Jul 28, 2006 3:31 PM
Subject: Re: [Openpacket-devel] Bulk PCAP files upload
To: "David A. Belle-Isle" <ml...@im...>
Cc: ope...@li...

 One way you could manage that is to get the user to archive the traces,
tar.gz, RAR, whatever, and then upload the archive (possibly extracting
automatically on the server side, though that's a bit dicey).  Depending on
how the upload is done, you may want to make it a seperate page from the
single-trace upload.

-Tim

 On 7/28/06, David A. Belle-Isle <ml...@im...> wrote:
>
> Hi Jacob,
>
> Thanks for the input.
>
> I agree with you if we needed to upload a couple of files at the
> sametime but we are talking about thousands of files here. I doubt the
> user would be interested in clicking "Browse..." a thousand time! :)
>
> Thanks,
>
> David
>
>
>
> Jacob Ham wrote:
> > Either through the use of ajax, just some javascript, it could
> > automatically add another file field after they have selected a file
> > to be uploaded.  When they have finished, just add these to a file
> > table.  There would have to be many-to-many relationship to this file
> > table from the trace table.  Then it would be possible for a trace to
> > have many capture files.
> >
> > If you need me to elaborate more, please let me know.
> >
> > Jake
> >
> > On 7/28/06, David A. Belle-Isle < ml...@im...> wrote:
> >> Hi everyone,
> >>
> >> We decided to have the option to be able to upload a large number of
> >> files at the same time (bulk upload) to the trace files repository.
> >> (Additionally to the option of uploading one file at a time)
> >>
> >> The problem is that I can't figure out a way to do it! If you have an
> >> idea or if you have already done that I would like to know it and have
> >> some details of how this could be possible.
> >>
> >> So far I developped the project in python using the django web
> >> development framework.
> >>
> >> If you need any additional info let me know, I'll post what you need.
> >>
> >> Thanks a lot,
> >>
> >> David
> >>
> >>
> >>
> >>
> -------------------------------------------------------------------------
> >> Take Surveys. Earn Cash. Influence the Future of IT
> >> Join SourceForge.net's Techsay panel and you'll get the chance to
> >> share your
> >> opinions on IT & business topics through brief surveys -- and earn cash
> >>
> http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
> >> _______________________________________________
> >> Openpacket-devel mailing list
> >> Ope...@li...
> >> https://lists.sourceforge.net/lists/listinfo/openpacket-devel
> >>
> >
>
>
>
> -------------------------------------------------------------------------
> Take Surveys. Earn Cash. Influence the Future of IT
> Join SourceForge.net's Techsay panel and you'll get the chance to share
> your
> opinions on IT & business topics through brief surveys -- and earn cash
> http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
> _______________________________________________
> Openpacket-devel mailing list
> Ope...@li...
> https://lists.sourceforge.net/lists/listinfo/openpacket-devel
>



-- 
Tim Furlong
tim...@gm...


-- 
Tim Furlong
tim...@gm...

Re: [Openpacket-devel] Bulk PCAP files upload

[Richard B. <tao...@gm...>]

On 7/28/06, David A. Belle-Isle <ml...@im...> wrote:
> Hi Jacob,
>
> Thanks for the input.
>
> I agree with you if we needed to upload a couple of files at the
> sametime but we are talking about thousands of files here. I doubt the
> user would be interested in clicking "Browse..." a thousand time! :)
>

David is right -- I have a lead on a source you might supply somewhere
around 1500 traces per month.

Perhaps once David or I can make David's demo accessible to others,
you will see the problem we are trying to solve.

Sincerely,

Richard

Re: [Openpacket-devel] Bulk PCAP files upload

[Tim F. <fu...@cc...>]

If it's going to be a regular thing, it might be worth building an
alternate, non-web-based, backchannel, especially if the meta-info can be
automatically generated.  If openpackets.org is run off a database, then it
wouldn't be too hard to set up a small application with a simple protocol to
listen to a port and accept submissions from a remote cron job or script and
populate the database appropriately.

On 7/28/06, Richard Bejtlich <tao...@gm...> wrote:
>
> On 7/28/06, David A. Belle-Isle <ml...@im...> wrote:
> > Hi Jacob,
> >
> > Thanks for the input.
> >
> > I agree with you if we needed to upload a couple of files at the
> > sametime but we are talking about thousands of files here. I doubt the
> > user would be interested in clicking "Browse..." a thousand time! :)
> >
>
> David is right -- I have a lead on a source you might supply somewhere
> around 1500 traces per month.
>
> Perhaps once David or I can make David's demo accessible to others,
> you will see the problem we are trying to solve.
>
> Sincerely,
>
> Richard
>
> -------------------------------------------------------------------------
> Take Surveys. Earn Cash. Influence the Future of IT
> Join SourceForge.net's Techsay panel and you'll get the chance to share
> your
> opinions on IT & business topics through brief surveys -- and earn cash
> http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
> _______________________________________________
> Openpacket-devel mailing list
> Ope...@li...
> https://lists.sourceforge.net/lists/listinfo/openpacket-devel
>



-- 
Tim Furlong
tim...@gm...

Re: [Openpacket-devel] Bulk PCAP files upload

[Bamm V. <bam...@gm...>]

Another option may be to have an anonymous upload (write no read) FTP
server similar to what SourceForge supplies for file releases. One
could upload all their files to that server, then tag/add them via a
web interface. The server could be set up to automatically delete any
files that have been "moved" in x hours.

Bammkkkk


On 7/28/06, Tim Furlong <fu...@cc...> wrote:
>
>
> If it's going to be a regular thing, it might be worth building an
> alternate, non-web-based, backchannel, especially if the meta-info can be
> automatically generated.  If openpackets.org is run off a database, then it
> wouldn't be too hard to set up a small application with a simple protocol to
> listen to a port and accept submissions from a remote cron job or script and
> populate the database appropriately.
>
>
> On 7/28/06, Richard Bejtlich <tao...@gm...> wrote:
> > On 7/28/06, David A. Belle-Isle <ml...@im...> wrote:
> > > Hi Jacob,
> > >
> > > Thanks for the input.
> > >
> > > I agree with you if we needed to upload a couple of files at the
> > > sametime but we are talking about thousands of files here. I doubt the
> > > user would be interested in clicking "Browse..." a thousand time! :)
> > >
> >
> > David is right -- I have a lead on a source you might supply somewhere
> > around 1500 traces per month.
> >
> > Perhaps once David or I can make David's demo accessible to others,
> > you will see the problem we are trying to solve.
> >
> > Sincerely,
> >
> > Richard
> >
> >
> -------------------------------------------------------------------------
> > Take Surveys. Earn Cash. Influence the Future of IT
> > Join SourceForge.net's Techsay panel and you'll get the chance to share
> your
> > opinions on IT & business topics through brief surveys -- and earn cash
> >
> http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
> > _______________________________________________
> > Openpacket-devel mailing list
> > Ope...@li...
> >
> https://lists.sourceforge.net/lists/listinfo/openpacket-devel
> >
>
>
>
> --
>
> Tim Furlong
> tim...@gm...
> -------------------------------------------------------------------------
> Take Surveys. Earn Cash. Influence the Future of IT
> Join SourceForge.net's Techsay panel and you'll get the chance to share your
> opinions on IT & business topics through brief surveys -- and earn cash
> http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
>
> _______________________________________________
> Openpacket-devel mailing list
> Ope...@li...
> https://lists.sourceforge.net/lists/listinfo/openpacket-devel
>
>
>


-- 
sguil - The Analyst Console for NSM
http://sguil.sf.net