Re: [mbackup-devel] berkeley db3

[John H. <jo...@mw...>]

Dear James,

A long time ago we were talking about mbackup and such things as XML.

I decided that mbackup wasn't going to be targetted at my needs.
In the time honoured fashion of scratching an itch I have designed
'Darkserve' A nod in the direction of Midnight backup and a poke at
Arcserve.

Little has come of it, however I have produced code for testing the
location facility. I originally tried Postgres, but could not get the
performance.

I recoded with Berkeley DB version 4.

My test showed that with modest hardware, I can get 700,000 record
inserted across several tables in about 10 sec. (IIRC) 

Anyway performance is EXCELLENT.

version 4 has substantial advantages WRT secondary indexes. I had no
troubles installing it under usr/local from the tarball.


The documentation on sleepycats' site is superb.



My current tarball is ftp.mwk.co.nz 
/pub/linux/darkserve-2002-01-07a.tar.gz


ignore the project crap and use the files in
src/location.

The main file has a couple of test routines for populating and
deleting test data.

Documentation for the system is in the doc directory and it 
decribes how the system is supposed to work, including the location
system. The SQL code is also relevant.

The location system is designed for unlimited flexibility.
The lookup table is where things happen and has lots of records.
The location schema for a filesystem has 5 records in there per
object backedup. Eg for /etc/samba/smb.conf  the lookup tables will
have.

Label		Value		ObjID
'PATH'		'/etc/samba'	'ID00001'
'FILE'		'smb.conf'	'ID00001'
'TYPE'		'F'		'ID00001'
'DATETIME'	'2001-12-03T23:01:01'	'ID00001'
'SERVER'	'albatross.hisdad.org.nz'	'ID00001'



So you see this table will get a _LOT_ of activity.
My tests have satisfied me that DB V4 is a good choice.

Everything there is copyright me and GPL'd, so feel free to fill your
boots. Not however, that there is much code.

I'm using the C library, but DB does have a C++ library, which looks
equally well documented.

I hope that you will find this helpfull

Regards

John