#633 Running many concurrent jobs with file transfers causes errors

UNICORE6.6
closed-fixed
None
6.6
5
2013-12-13
2013-06-06
No

When many concurrent jobs try to stage data in/out, errors are very common, like resource unavailable, http timeouts, etc. For example, running for-each workflows including jobs that stage in a directory. This should be stable under non-trivial load.

Discussion

  • Andre Gemuend

    Andre Gemuend - 2013-06-06

    Is there something I can do about this in configuration?

     
  • Bjoern Hagemeier

    • Affected Versions: --> 6.6
     
  • Bernd Schuller

    Bernd Schuller - 2013-12-13
    • status: open --> closed-fixed
    • Fixed in: -->
     
  • Bernd Schuller

    Bernd Schuller - 2013-12-13

    should be better now (workflow 6.6 and unicorex 7.0)

     
  • Andre Gemuend

    Andre Gemuend - 2013-12-13

    Great to hear. We will evaluate and report back. Does the workflow system also use the UFTP session support now?

     
  • Bernd Schuller

    Bernd Schuller - 2013-12-13

    no, UFTP sessions are only available with UNICORE 7.x, and will require some changes to the service orchestrator.

     

Log in to post a comment.

Get latest updates about Open Source Projects, Conferences and News.

Sign up for the SourceForge newsletter:





No, thanks