#65 Files not processed

open
Mark Hessling
None
5
2003-02-26
2002-09-16
Rod Dav4is
No

Refer to problem 610215, as the same nonce utility is
involved.

After verifying proper operation of the utility
with a few files, I removed the constraints and watched it grind
through some 2000 files, with no outward evidence of any
failure.

It turns out that, although the utility listed the
right number of files, and displayed their names in turn, and (I am
certain) performed the two Address System commands (1. read and
process the file to an array; 2. rewrite the file) -- at some point the
files were not actually replaced. I discovered this by running my
application, which tripped over some unrepaired files. Another
run of the Repair utility also seemed to go OK, but, again, a number
of files were not changed. It took about a dozen runs to completely
change all the files!

If Regina is not properly closing those
files, are there not system limits on number of concurrently open
files?

1. Regina should manage its resources better.
2.
Open failures should be reported to the user/application.

-R.

Discussion

  • Logged In: YES
    user_id=262734

    Before we look into Regina to find the error we have to
    be sure that the error doesn't relate to the OS.
    Have a look at my comment to bug 608677 which is
    a bug of the system.

    I have a question about your data processing.
    You say you do an "ADDRESS SYSTEM command"
    to process the file and then do a rewrite by Regina.
    Is the command a command-line command or a
    GUI command?

     
  • Rod Dav4is
    Rod Dav4is
    2002-10-02

    Logged In: YES
    user_id=368122

    The nonce script and pipeline stage are attached to problem 610215,
    which seems related.

     
  • Logged In: YES
    user_id=262734

    I can't reproduce it. Can you please supply either a list
    of *.dp! files or tell how to create a test set?
    I assume time time stamp condition has to be removed.

    By checking some other things I saw a possible
    problem with streams. They are not closed implicitely.
    It may a good idea for the first to do an expicite close
    to each stream which is involved by ADDRESSed processes.
    This regards only to files which will be opened by the
    called application, not to those one used by WITH.

    I'll check the standard whether Regina must close all
    files in between.

     
  • Rod Dav4is
    Rod Dav4is
    2002-10-02

    Logged In: YES
    user_id=368122

    I doubt that the type or content is important, but have attached a sample
    anyway. They are simple, short flat files producted by PPW: a/k/a
    dependancy files.

    Of course, this sample doesn't have any of the
    lines that my nonce utility was written to remove...

    -R.

     
  • Rod Dav4is
    Rod Dav4is
    2002-10-02

    sample dp! file. 1 of ~2000

     
    Attachments
  • Mark Hessling
    Mark Hessling
    2003-02-26

    • assigned_to: nobody --> rexx