On Mon, Jun 16, 2014 at 12:24 AM, Ron Johnson <ron.l.johnson@cox.net> wrote:
On 06/15/2014 09:53 PM, Doug Blank wrote:
On Sun, Jun 15, 2014 at 1:39 PM, Ron Johnson <ron.l.johnson@cox.net> wrote:
DB as "BLOB storage device?  Interesting...

Yes, in fact the Django databases uses the blob formats to keep speed up and keep compatibility. Knowing that we use the database mostly for these blobs, it should be fairly easy to swap out bsddb at some point, even if we use a relational database to store blobs.

So, no querying with sqlite3 from the bash prompt...  :(

Yes, you can. The webapp keeps the pickled blob, but also stores the data relationally. Its the best of both, even if it uses more space.

> The Gramps XML is more human-readable and should be used for backups.

I do.  My curiosity was just piqued by the format, though.

BTW, one could also export in JSON too by calling .to_struct() on these objects as you write them out. That would also be an interesting format between raw and XML.

What's the size comparison of a JSON dump vs. XML?  If it's noticeably smaller, and an importer is easy to write, would it be a better backup format?

The JSON export doesn't exist yet, and neither does the import. Uncompressed JSON would probably be smaller than uncompressed XML---who knows how well it would compress. But the differences in sizes between it and XML would be negligible. The important aspect of a backup is: can you restore from it over time? 


My word, man!  Don't you know your quantum statistics?

HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions
Find What Matters Most in Your Big Data with HPCC Systems
Open Source. Fast. Scalable. Simple. Ideal for Dirty Data.
Leverages Graph Analysis for Fast Processing & Easy Data Exploration
Gramps-users mailing list