[TS-devel] Database vs. flat-file

[Marcus <li...@wo...>]

Matthew Tuck wrote:
>> - All SQL joins split for speed (5-10 times faster on large
databases
>> such as memes.net)

>I'm interested in this statement - I presume this means that you are
>using a database to store things rather than a flat file.

>I had considered using a database for the similar application I'm
>writing, but am now heading towards a file storage.  What were the
>reasons you decided to go with a database?

Originally I wrote Prima for the web (CGI), about 1.5 - 2 years ago
using Mysql. So the code was database ready :-)

I just needed to find a DB for the desktop because Mysql is too
complicated for people to set up. Just as it looked as though I may not
find a cross-platform DB, and have to use you-know-who's bloated
products, I discovered SQLite, which is great. Public domain, small,
fast, cross-platform. C/C++, Python and Perl access :-)
(www.hwaci.com)

Back to TS: My main "problem" (read extra work) converting between
Prima and TS is that TS generates it's own alpha-numerical ids whereas
Prima lets the DB auto-increment integers, as does Lucid.

So that would be one difference to using a flat-file. Speed may welll
be another. Just take memes.net and try sifting that from a flat-file.
Ben imported memes.net (in part) to TS so maybe he can comment on the
speed issue. May depened on your XML or CSV parser.
Also, I guess you are limited on the PalmOS, so a DB may not be an
option. Portability was presumably Ben's main consideration for using a
flat file if TS was to run on PalmOS, Linux, Windows?

In general I prefer a DB, just as a matter of personal preference.
Also, I can switch DB applications and leave the SQL queries (Well,
95%). A great benefit after 1.5 years away from the code :-)

Marcus