Menu

#40 sr_sarra some files not deleted?

SarraBeta
closed
None
3
2018-06-02
2016-06-06
psilva
No

In a certain configuration, sr_watch is posting thousands of files per hour. sr_sarra is reading them and using sftp to retrieve them. sr_sarra has the 'delete' option on to delete files at source after the transfer is done. In almost all cases, this works, but it looks like a dozen or so files per hour remain in this stream.

Discussion

  • Daluma S

    Daluma S - 2016-06-08

    Confirming that sr_sarra fails to delete a file that was posted by sr_watch.

    error log from sarra (removing some local info)
    sr_sarra_get_....log:2016-06-08 15:41:49,255 [ERROR] Download failed sftp://login@server//file Type: <class 'attributeerror'="">, Value: 'NoneType' object has no attribute 'chdir'</class>

     
  • psilva

    psilva - 2017-04-24

    This definitely still happens, looking in sr_sarra log, it says it's deleting the file, but the file remains, happenning on cmo-dsr for RADAR META and GIF data. Sarra still grabs and publishes the file correctly, but sometimes it doesn't succeed in deleting the file.

     
  • psilva

    psilva - 2017-04-24

    the current example is with sr_poll, not sr_watch. So likely this problem is with sarra, not poll or watch.

     
  • psilva

    psilva - 2017-04-24
    • assigned_to: Daluma S --> Eric Funk
    • Priority: 5 --> 3
     
  • psilva

    psilva - 2017-04-24

    not causing major problems, intend to put a cron to delete the files once they get old enough.

     
  • psilva

    psilva - 2018-06-02
    • status: open --> closed
     
  • psilva

    psilva - 2018-06-02
     

Log in to post a comment.

MongoDB Logo MongoDB