Re: [Gramps-users] Using Gramps with Large Quantities of data

[Doug B. <dou...@gm...>]

On Sat, Oct 20, 2012 at 6:42 AM, Martin <mar...@go...> wrote:
> I currently have a Rootsmagic V3 database with about 1.2m people entries.
> I am stuck on V3 because of performance problems with my data migrating to
> V4 and V5.
>
> So I need a solution, which is either:
> - write my own (java and mysql)
> - use another package.
>
> I have exhausted most of the proprietary packages and I am currently trying
> to get Gramps to work.
> I have installed it on both Ubuntu and Windows-XP. (version is gramps 3.3).
> My problem is importing the GEDCOM which is 1.25GB in size.
> After 12 hours (on windows) it says it is at 25% loaded and I think it is
> slowing down the db directory has 1310 log files, the person db is 332Mb and
> the notes db is 1.4GB (will that be a problem given it is so far at only
> 25%!). It is currently using 1Gb of the 2GB of memory of the machine and
> running at about 50% utilisation. Happy to leave it running for several days
> on a machine which is doing nothing else. Even if I leave it to completion,
> assuming it won't fall over will it work with any degree of performance? I
> also have plans which will take the data up to 4m entries, and no I don't
> want to split the data up and for sure can't do that with the existing data.
>
> I tried using the instructions about the DB_CONFIG file but it pops up a
> message saying there is invalid syntax, which there isn't (copy and paste
> the contents).
>
> Any views on how to progress?

Personally, I would not use regular Gramps on a database of 1.2M
people. But there is a third choice: use mysql (or whatever) with
Gramps Connect.

Gramps Connect is a project that I've been working on for the last few
years to replicate the Gramps DB interface (so all reports and
functions will still work), but allow different backends, on the web.
The main goal of the project is to allow collaboration, especially
with large databases. As a nice side-effect, it also give a nice
mobile interface to Gramps as well.

Gramps Connect is about 85% done, and I hope to finish it completely
in the next year. I already have my family database on line, and have
been beta-test using it for the last few months.  It can import from
Gramps XML, or GEDCOM, on the web, and run any Gramps report. Most of
the data can be edited/added/deleted.

You can see a demo at: http://gramps-connect.org/ (id: admin, password: gramps)

More details:

http://www.gramps-project.org/wiki/index.php?title=GEPS_013:_GRAMPS_Webapp

Let me know if you would like to work on this, and I'll get you started.

-Doug

> --
>
>
> Regards...
>
> Martin Ferrier, FIET.
>
>
>
> Visit my Genealogy Repository.
>
>
>
>
> ------------------------------------------------------------------------------
> Everyone hates slow websites. So do we.
> Make your web apps faster with AppDynamics
> Download AppDynamics Lite for free today:
> http://p.sf.net/sfu/appdyn_sfd2d_oct
> _______________________________________________
> Gramps-users mailing list
> Gra...@li...
> https://lists.sourceforge.net/lists/listinfo/gramps-users
>