From: jerome <rom...@ya...> - 2014-04-09 09:18:47
|
True, the performances page is outdated. Updates are welcome! I also made a simple records handling test recently (gramps 40 vs gramps 34) and came to the same conclusion. I was able to get better performances, but I do not know if it is related to my current testing version (gramps40 from git, close to 4.0.4), or some local configuration changes (rebuild gramps.ini, disable some plugins, optimization flag on command line, etc ...). Anyway, it seems that devs working on python-gobject know this performances issues (python and gtk3 vs gtk2) and they are working on solutions. About test itself, maybe this cannot help, but to run gramps without GUI will be faster. Maybe this could be minor on import? You can try to 'optimize' large database. There is also some differences when some specific bsddb flags are enabled or not, around transactions, logs, etc ...). This needs some DB knownledges... One section of the gramps wiki is dedicated to large database ! " Loading the file Inital import of a large (100.000+) database from either gramps format or gedcom is tiresome and can take a few hours. You will need to adjust the number of allowable locks. For 140.000 people you should use: max_locks 300000 and max_objects 300000 The easiest way to do this is to: 1. create a new Family Tree 2. exit gramps 3. add a DB_CONFIG to the database directory before importing (see gramps -l output for the directory of a specific family tree. Contents of this DB_CONFIG file should be: #may want to fiddle with cachesize also #set_cachesize 0 200000000 2 set_lk_max_locks 300000 set_lk_max_objects 300000 " Tips for large databases - Gramps Hope this could help! regards, Jérôme Le Mardi 8 avril 2014 23h34, TJMcK <tim...@gm...> a écrit : I just finished skimming over a very interesting thread entitled: Large Gramps file-transfer. I've been searching for information regarding Gramps minimum hardware required and maximum files sizes recommended. This question came up when I tried to load a 2gig test gedcom... I let the gramps import run for 24 hours and it only processed a small percentage of the file. So, I tried a gedcom that was just over 1gig, I left gramps run for about 48 hours (while I was away) -- it seemed to get stuck at about 46% processed. My computer-laptop, is not old, I purchased it a few months ago... mind you it was discontinued because it is on the low end for current hardware. It has a AMD dual core 1700mhz processor with 7 gig ram. Incidentally I did find some testing - benchmarking done that was reported on the gramps wiki. I found it very interested, but very much outdated. I would like to see this updated. So, my main question is: Are large files regularly tested or used with Gramps? Has someone done a 2gig ged import recently -- or will gramps not import a file that size? My regular database has more then 200,000 individuals... and I find some really slow spots. If development were testing large files >1million people, I think that it would be useful to find some problematic areas that tend to slow down gramps. (I have a list of really slow areas that I think gramps developers might be able to improve on.) BTW, I really wanted to import the 1 gig file, (even it was read-only), and since I couldn't use gramps I downloaded a couple of windows programs, installed them in a virtual window with winxp (on this same computer), and two of the programs imported this huge gedcom in around 12 hours (gedviewer lite for windows loads within a minute) ! -- View this message in context: http://gramps.1791082.n4.nabble.com/gramps-testing-with-very-large-files-tp4665484.html Sent from the GRAMPS - User mailing list archive at Nabble.com. ------------------------------------------------------------------------------ Put Bad Developers to Shame Dominate Development with Jenkins Continuous Integration Continuously Automate Build, Test & Deployment Start a new project now. Try Jenkins in the cloud. http://p.sf.net/sfu/13600_Cloudbees _______________________________________________ Gramps-users mailing list Gra...@li... https://lists.sourceforge.net/lists/listinfo/gramps-users |