Re: [Bobs-devel] file index issue again

[Rene <re...@gr...>]

Cool.

I actually think db3 is a little slower than grep, but not when
comparing against min_size,max_size,name and possibly path. Which is
what we need.

I'll go redesign bobs (for the 5th time ;)


Rene


btw: I just bought a new home server and I'm messing with it right now.
Just as a warning if you get a bounce or I don't reply to an email that
was lost.



On Thu, 2002-07-18 at 08:46, Joe zacky wrote:
> I think it's a great idea. I used db3 in a couple c programs in linux. 
> It's a standard linux database. I don't doubt that it's much faster than 
> a text file. I just checked my RedHat 7.3 php options and it did come 
> with "--with-db3" compiled in.
> 
> I'm working on what the screens will look like in the new admin 
> interface. I'm creating prototypes in plain html. I'll send them to you 
> when I'm done, to get your opinion.
> 
> Joe
> 
> Rene wrote:
> 
> >I've been looking at the file index structure. 
> >
> >Maybe using flat files wasn't such a Great Idea(tm) in the long run.
> >I've done some research into using db3 (sleepycat software) instead.
> >Results are nice. It's a really simple database and fairly quick as
> >well.
> >
> >I did a test in which I searched for files larger than x bytes, smaller
> >than y bytes and contains the string "ab" in its name.
> >It took less than 4 seconds to parse the database. That was with ~130000
> >files.
> >Each files has 4 entries "path","name","date" and "size"
> >
> >The db file is 38 MB in size. The index file I used to fill the database
> >is only 13 MB in size.
> >
> >But the search speed is really amazing compared to the way bobs do it.
> >
> >I tested this on a athlon 1800+ SMP computer. (it only uses on cpu for
> >searching)
> >
> >Check this link for more information.
> >http://dk.php.net/manual/en/ref.dba.php
> >
> >Redhat 7.2 and 7.3 ships php with db3 enabled.
> >
> >
> >To make it completely useable there would have to be at least to
> >databases for each share. One for the files and one for the dirs.
> >In the dirs database the should be a reference to which index numbers
> >that dir has in the file database.
> >eg.
> >index 0 = /somedir/at/some/path/
> >index 1 = 1000-1304
> >which would indicate that there are 304 files in this dir and they are
> >located between index 1000 and index 1304 in the file database.
> >
> >This is needed for a really fast search which is needed when we display
> >files in the browser.
> >
> >This way a share with 15000 dirs should take less than 1 second to
> >display a file list in the browser.
> >
> >The real feature is that this is a 1000 times easier to handle in php.
> >
> >
> >Let me know what you think.
> >Is it a good idea to use it?
> >
> >-Rene
> >
> >
> >
> >-------------------------------------------------------
> >This sf.net email is sponsored by:ThinkGeek
> >Welcome to geek heaven.
> >http://thinkgeek.com/sf
> >_______________________________________________
> >Bobs-devel mailing list
> >Bob...@li...
> >https://lists.sourceforge.net/lists/listinfo/bobs-devel
> >
> >  
> >
> 
> 
> 
> 
> -------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Bobs-devel mailing list
> Bob...@li...
> https://lists.sourceforge.net/lists/listinfo/bobs-devel