Re: [Gramps-devel] Re : Re : GRAMPS Performance ...

[Benny M. <ben...@gm...>]

2011/9/8 jerome <rom...@ya...>

> I should really better check and read the message once it has been
> written...
>
> > About tests, results is excellent (except import...).
>
> 'results are excellent' or 'result is excellent'... :-[
>
> > load treeview new more time
>
> needs more time !
>
>
> Anyway, about time to import large file, I suppose we can still manually
> edit the cache (or transaction options, or whatever the cause) for a local
> optimization.
>
> Note, on some part of the code, Gramps is using something like:
>    posixpath.getsize(filename)
>
> I guess there one limit where we can say it is a large file, isn' it ?
>
> So, if there is one way to get the data import in 23/25min (like 2.2.6
> version), it is already better than around 2 hours ...
>
> Time to import a small file sounds good.
> Only to import a large file is a little bit painful/too_long!
>
> I will try to see what could be the cause of the faster import on 2.2.6
> against current one. I just hope this has nothing to do with the new commit
> method, and I may be able to understand the difference!
>

Ok,

nice that somebody does these test again.
Talk to Nick W to put the file on the server to test.
And yes, update that wiki page with updated data's. The slower import can
also be due to the fact we have many more database tables since 2.2 (notes,
tags), but 4x slower is a bit much.

Benny


>
> Regards,
> Jérôme
>
>
>
> --- En date de : Mer 7.9.11, jerome <rom...@ya...> a écrit :
>
> > De: jerome <rom...@ya...>
> > Objet: [Gramps-devel] Re :  GRAMPS Performance ...
> > À: gra...@li...
> > Date: Mercredi 7 septembre 2011, 21h10
> > > Finally, I just wonder if it is
> > not possible to also keep
> > > previous import performance like Gramps 2.2.4, 2.2.6,
> > 3.1.2
> > > and current responsiveness ?
> > > both together ?
> >
> > I am wrong ...
> > Import under Gramps 3.1.2 was for GEDCOM file !
> >
> > So, it is not possible to have the same import time as
> > Gramps 2.2.6 for Gramps XML files ?
> >
> >
> >
> > --- En date de : Mer 7.9.11, jerome <rom...@ya...>
> > a écrit :
> >
> > > De: jerome <rom...@ya...>
> > > Objet: [Gramps-devel] GRAMPS Performance ...
> > > À: gra...@li...
> > > Date: Mercredi 7 septembre 2011, 21h04
> > > Hi,
> > >
> > >
> > > I take some time for testing Gramps 3.3.0 performance
> > !
> > > http://gramps-project.org/wiki/index.php?title=GRAMPS_Performance
> > >
> > > The good news is that responsiveness is still good.
> > > The bad thing is that I needed around 2 hours for
> > importing
> > > one testing database with 124 032 people (2 upgrades;
> > > generated on 2009).
> > >
> > > The good news is that we can close:
> > > http://www.gramps-project.org/bugs/view.php?id=2681
> > > I cannot reproduce it with last stable release and a
> > very
> > > "light" desktop config.
> > >
> > > Now, I will make new tests with updated database
> > (after
> > > upgrades).
> > > I suppose this could be a good idea to put this
> > updated
> > > database under
> > > http://www.gramps-project.org/files/stresstestdata/
> > too
> > > ?
> > > File is around 20.6Mio.
> > >
> > > About tests, results is excellent (except import...).
> > >
> > > I suppose clean/nonclean does not make sense under my
> > > environment, because python is already loaded on
> > startup, no
> > > ? But I get two results, which should not be ignored:
> > to
> > > load treeview new more time than flatview. So, tests
> > related
> > > to filter and loaded views should be done with
> > treeview
> > > *and/or* flatview. To display Person "FlatView" needs
> > 16
> > > seconds under my config/session, 30 seconds for the
> > Person
> > > "TreeView" !
> > >
> > > Finally, I just wonder if it is not possible to also
> > keep
> > > previous import performance like Gramps 2.2.4, 2.2.6,
> > 3.1.2
> > > and current responsiveness ?
> > > both together ?
> > >
> > >
> > >
> > > Regards,
> > > Jérôme
> > >
> > >
> >
> ------------------------------------------------------------------------------
> > > Using storage to extend the benefits of virtualization
> > and
> > > iSCSI
> > > Virtualization increases hardware utilization and
> > delivers
> > > a new level of
> > > agility. Learn what those decisions are and how to
> > > modernize your storage
> > > and backup environments for virtualization.
> > > http://www.accelacomm.com/jaw/sfnl/114/51434361/
> > > _______________________________________________
> > > Gramps-devel mailing list
> > > Gra...@li...
> > > https://lists.sourceforge.net/lists/listinfo/gramps-devel
> > >
> >
> >
> ------------------------------------------------------------------------------
> > Using storage to extend the benefits of virtualization and
> > iSCSI
> > Virtualization increases hardware utilization and delivers
> > a new level of
> > agility. Learn what those decisions are and how to
> > modernize your storage
> > and backup environments for virtualization.
> > http://www.accelacomm.com/jaw/sfnl/114/51434361/
> > _______________________________________________
> > Gramps-devel mailing list
> > Gra...@li...
> > https://lists.sourceforge.net/lists/listinfo/gramps-devel
> >
>
>
> ------------------------------------------------------------------------------
> Doing More with Less: The Next Generation Virtual Desktop
> What are the key obstacles that have prevented many mid-market businesses
> from deploying virtual desktops?   How do next-generation virtual desktops
> provide companies an easier-to-deploy, easier-to-manage and more affordable
> virtual desktop model.http://www.accelacomm.com/jaw/sfnl/114/51426474/
> _______________________________________________
> Gramps-devel mailing list
> Gra...@li...
> https://lists.sourceforge.net/lists/listinfo/gramps-devel
>