Menu

#574 libgphoto2 out of memory after 1024 files

closed-fixed
libgphoto2 (82)
9
2007-10-17
2006-07-01
tonygerber
No

Sorry if this is a known limitation, but I couldn't
find it mentioned anywhere in the documentation or
other bug reports. libgphoto2 appears to have a
hard-coded limit of 1024 files. Using gphoto2 with a
camera with a 1Gb SD card with well over 1024 images on
it results in a mysterious "out of memory" message and
instant termination. The problem appears to be a
hard-coded MAX_ENTRIES value of 1024 in
libgphoto2/gphoto2-list.h.
Changing this to 2048 and rebuilding fixed my problem.
It would be nice if this were a changeable setting.

Discussion

  • Marcus Meissner

    Marcus Meissner - 2006-07-01

    Logged In: YES
    user_id=48092

    yeah. :/

     
  • Marcus Meissner

    Marcus Meissner - 2006-10-29

    Logged In: YES
    user_id=48092

    we started working on this.

    unfortunately up to now we exported a structure with a fixed 1024 entry array to
    applications.

    with 2.3 we will stop this and we can change the limit for 2.4.

     
  • Rich

    Rich - 2006-12-10

    Logged In: YES
    user_id=1450055
    Originator: NO

    Hi,

    I installed the latest version 2.3 after running into the 1024 limit.
    Same issue in 2.3, changed the value to 2048 for in libgphoto2/gphoto2-list.c and recompiled.

    Worked fine for listing and downloading images.

    This may want to look into - I have a 2GB card and reached 1,200 photos, with room for another 400.
    So the 2048 may also be limiting with larger cards.

    Thanks - great product. Works great with the Fuji S6000fd model.

    Regards,
    Rich

     
  • f33l

    f33l - 2007-08-01

    Logged In: YES
    user_id=1558162
    Originator: NO

    Not sure, if this is the very same problem, but I am getting a "fixed limit exceeded" message, when trying to access my 8GB card with over 1000 photos on it. I upgraded to libgtphoto2 2.4, but the problem remains.

    Is there a way to alter this "fixed limit"?

     
  • Marcus Meissner

    Marcus Meissner - 2007-08-02

    Logged In: YES
    user_id=48092
    Originator: NO

    Yes, if the same directory has more than 1024 files.
    Also if filenames are longer than 128bytes.

    The problem is that the limit was exposed to userprograms and so is part of the library API. We want to avoid such a change making the library incompatible.

     
  • Marcus Meissner

    Marcus Meissner - 2007-08-12
    • priority: 5 --> 9
     
  • Marcus Meissner

    Marcus Meissner - 2007-10-17
    • assigned_to: nobody --> marcusmeissner
    • status: open --> closed-fixed
     
  • Marcus Meissner

    Marcus Meissner - 2007-10-17

    Logged In: YES
    user_id=48092
    Originator: NO

    I committed a change to libgphoto2 which fixes both issues.

    This will be in the next release (not sure when it will happen).

    It required the major SO version to be increased.

     
  • aditsu

    aditsu - 2009-10-03

    Seems to be corrected in SVN in 2007, but your latest release (2.4.7) does not include the fix! What are you guys doing?!?

     
  • Matt Williams

    Matt Williams - 2010-02-09

    Yeah, I see that this has been fixed in revision 10790 (http://gphoto.svn.sourceforge.net/viewvc/gphoto?view=rev&revision=10790) 2 years and 3 months ago. However, it seems it was only done a few months after 2.4 was branched (http://gphoto.svn.sourceforge.net/viewvc/gphoto/branches/libgphoto2-2_4/libgphoto2/libgphoto2/gphoto2-list.c?view=log). This means that this fix is not in any of the released versions.

    Over the last two years the size of memory cards has increased a lot and 8 or 16 GB cards are not uncommon. This means that a large portion of users are finding LibGPhoto unusable.

    Will we have to wait until a 2.5 release or is there a chance the fix could be backported? The fix only seems to affect one file which hasn't changed in the mean time.

    Thank you

     

Log in to post a comment.