#50 Support of large multipart gedcoms

phpGedView
closed-fixed
John Finlay
7
2003-10-21
2003-08-07
Veit
No

I have the problem that my provider limits ressources
and time granted for PHP scripts. If I have to import a
large gedcom, the script is killed during runtime.
I can break down the gedcom in smaller pieces (abt
1MB). They are named test.ged.01, test.ged.02 ...
The name in the database ist only recorded as test.ged.

I have begun to make some changes in the scripts and
can submit them to you.

In my version the family list is not working, but I don't
use it.

Discussion

1 2 > >> (Page 1 of 2)
  • John Finlay
    John Finlay
    2003-08-15

    Logged In: YES
    user_id=300048

    In the next version I am going to read the file in at 4k blocks
    at a time while importing. This will prevent the need to have
    a large stack size to import the gedcom.

    --John

     
  • John Finlay
    John Finlay
    2003-08-15

    • assigned_to: nobody --> yalnifj
    • status: open --> open-rejected
     
  • John Finlay
    John Finlay
    2003-09-18

    • status: open-rejected --> closed-rejected
     
  • Veit
    Veit
    2003-09-19

    Logged In: YES
    user_id=839525

    This is not what the RFE means. If you have a gedcom that
    contains 50000 individuals it takes a lot more than 1 minute
    to import this file. My provider and I think most of them kill a
    running PHP script after a defined time. My provider is doing
    this after 30 sec. So I have to be sure that an import is
    running no longer than 30 sec. I can do this in the way to
    separate the bib gedcom in smaller ones that are imported
    one after the other. A possible way could be also to run the
    script for a defined time and then set a marker how far it is
    imported and give a link to go further with the script. Or
    perhaps you have a better idea how to solve this?

     
  • Veit
    Veit
    2003-09-19

    • status: closed-rejected --> open-rejected
     
  • John Finlay
    John Finlay
    2003-09-19

    Logged In: YES
    user_id=300048

    You are right. I addressed the large memory issue, not the
    time limit issue. I think your suggestion of pausing the script
    when the time gets close to the limit and then providing a link
    or a button to continue is a great idea.

    --John

     
  • John Finlay
    John Finlay
    2003-09-19

    • priority: 5 --> 7
     
  • John Finlay
    John Finlay
    2003-09-30

    • status: open-rejected --> open-fixed
     
  • John Finlay
    John Finlay
    2003-09-30

    Logged In: YES
    user_id=300048

    I've added this to version 2.51, but haven't thoroughly tested
    it. It would be great if you could give it a try.

    --John

     
  • John Finlay
    John Finlay
    2003-10-07

    Logged In: YES
    user_id=300048

    I turned down my time limit and tested this to make sure that
    it works. I'm attaching a new importgedcom.php script that
    can be downloaded from here.

    --John

     
1 2 > >> (Page 1 of 2)