limit for number of records

  • dsfgg

    dsfgg - 2011-06-19

    whats the limit to total number of records(books) data that can be uploaded. When I am using marc upload , it is working fine with few books , but when the number of books is >12000, the error shown is 0 records uploaded. when i am doing test upload i get a warning
    Warning:  readfile() : Filename cannot be empty in /home/kite/public_html/openbiblio/catalog/upload_usmarc.php on line 100
    please help

  • Hans van der Weij

    Increasing upload_max_filesize in PHP.INI might help. It's a problem with the upload process, not a database limit.

    In the recent months I have experimented with uploading large amounts of MARC records, I think I have more useful information for you:

    One result, finished just this morning, is improved documentation for MARC Upload:

    Another result is more thourough bibliography search and addition of keyword search as search type. It works with OpenBiblio 0.6.x and the not yet released 0.7.0.

  • dsfgg

    dsfgg - 2011-06-21

    infintite-mnkz, thanks for the help
    so do u have any idea about the problem with upload process and how can it be corrected?

  • Hans van der Weij

    Well, try editing PHP.INI is indicated, and restart the webserver.
    OR split the upload file into smaller files, as described in the MARCUpload documentation (follow link in my previous post).

  • Hans van der Weij

    More detail:

    You probably don't run your own server (path something like /home/kite/public_html/), editing PHP.INI probably is not an option.
    Therefore, try splitting the 12.000 record file into smaller files.

    For splitting I used the yaz-marcdump utility. This is a commandline tool that comes with the YAZ toolkit from Index Data.
    Find a YAZ download for your system:
    Documentation for yaz-marcdump:

    This command will probably work for you:

    yaz-marcdump -C 1000 -s splitfile largefile

    If you use Windows, the full path probably will be "C:\Program Files\YAZ\bin\yaz-marcdump"
    A safe value for splitfile size is -C 500 , this will produce more splitfiles to upload.

    Is 12000 the total size of records, or do you plan to upload a lot more?

    Good luck, H.



Cancel  Add attachments

Get latest updates about Open Source Projects, Conferences and News.

Sign up for the SourceForge newsletter:

JavaScript is required for this form.

No, thanks