Re: [mbackup-devel] berkeley db3
Status: Alpha
Brought to you by:
jo2y
|
From: John H. <jo...@mw...> - 2002-01-07 04:22:11
|
Dear James, A long time ago we were talking about mbackup and such things as XML. I decided that mbackup wasn't going to be targetted at my needs. In the time honoured fashion of scratching an itch I have designed 'Darkserve' A nod in the direction of Midnight backup and a poke at Arcserve. Little has come of it, however I have produced code for testing the location facility. I originally tried Postgres, but could not get the performance. I recoded with Berkeley DB version 4. My test showed that with modest hardware, I can get 700,000 record inserted across several tables in about 10 sec. (IIRC) Anyway performance is EXCELLENT. version 4 has substantial advantages WRT secondary indexes. I had no troubles installing it under usr/local from the tarball. The documentation on sleepycats' site is superb. My current tarball is ftp.mwk.co.nz /pub/linux/darkserve-2002-01-07a.tar.gz ignore the project crap and use the files in src/location. The main file has a couple of test routines for populating and deleting test data. Documentation for the system is in the doc directory and it decribes how the system is supposed to work, including the location system. The SQL code is also relevant. The location system is designed for unlimited flexibility. The lookup table is where things happen and has lots of records. The location schema for a filesystem has 5 records in there per object backedup. Eg for /etc/samba/smb.conf the lookup tables will have. Label Value ObjID 'PATH' '/etc/samba' 'ID00001' 'FILE' 'smb.conf' 'ID00001' 'TYPE' 'F' 'ID00001' 'DATETIME' '2001-12-03T23:01:01' 'ID00001' 'SERVER' 'albatross.hisdad.org.nz' 'ID00001' So you see this table will get a _LOT_ of activity. My tests have satisfied me that DB V4 is a good choice. Everything there is copyright me and GPL'd, so feel free to fill your boots. Not however, that there is much code. I'm using the C library, but DB does have a C++ library, which looks equally well documented. I hope that you will find this helpfull Regards John |