|
From: Justin B. <jb...@ec...> - 2009-06-29 14:32:19
|
Hi All, Following on from the recent series of GridSAM releases. We are pleased to announce the release of GridSAM 2.1.6 This release mainly focuses on performance enhancements and bug fixes relating to the use of the ICT Condor DRM connector. See http://sourceforge.net/project/showfiles.php?group_id=141177&package_id=154979 GridSAM 2.1.6 is a release intended for developers and since the 2.1.5 release the following changes have been made. Added code to forcefully remove working directory and all files therein after a job has completed. This is enabled by adding deleteWorkingDirCompletely=true to StageOutStatusStage.properties. This feature is still under test and is disabled by default. It is useful for when disk space is very limited or when the size of job files are very large. (See subversion revision 432.) Refactored the code such that doPBSJob no longer has to be synchronized, it is instead throttled so a configurable number of job submissions can happen concurrently. This makes the submission of several jobs at once much smoother, as they don't all block behind the same long lived critical section. This change affects the the ICT Condor connector, the ICT PBS connector still requires further work to solve this issue. The level of concurrency can be set by adjusting the max_concurrent_submits property in ICTCondor.properties. (See subversion revision 429.) Removed the need to spawn separate threads to read in the output from forked subprocesses. This should result in faster more efficient execution for this module. Change from using Runtime.exec to the more modern ProcessBuilder. (See subversion revisions 427 and 428.) Added the "-backwards" command line argument to condor_history calls, as this speeds up the lookups considerably on a systems which have a large history. This is presumably as condor_history always iterates through the past jobs in order until it finds the one in question. We are always interested in recent jobs, so this change makes sense. (See subversion revision 425.) Create and reuse a single instance of DefaultFileSystemManager for use with the ICT DRM connectors. This fixes a significant resource leak issue. (See subversion revision 424.) Make the Condor submission file names and the shell used configurable. These need to be configurable specifically in the case where the execution nodes are Windows rather then Unix. The .origin files need to be named .bat and the #!/bin/sh line needs to be removed. (See subversion revision 423.) It is also designed to be used with OMII-UK's - Campus Grid Toolkit 1.1.3 - Development Kit 3.4.4 These are available from www.omii.ac.uk Support is available via su...@om... Regards, Justin -- Justin Bradley Design & Development Team Leader j.b...@om... OMII-UK Bay 23, 4067, B32 University of Southampton |