[gridsam-discuss] GridSAM 2.1.6 released

[Justin B. <jb...@ec...>]

Hi All,

Following on from the recent series of GridSAM releases.
We are pleased to announce the release of GridSAM 2.1.6

This release mainly focuses on performance enhancements and bug fixes  
relating to the use of the ICT Condor DRM connector.

See http://sourceforge.net/project/showfiles.php?group_id=141177&package_id=154979

GridSAM 2.1.6 is a release intended for developers and since the 2.1.5  
release the following changes have been made.

Added code to forcefully remove working directory and all files  
therein after a job has completed.  This is enabled by adding  
deleteWorkingDirCompletely=true to StageOutStatusStage.properties.   
This feature is still under test and is disabled by default.  It is  
useful for when disk space is very limited or when the size of job  
files are very large.
(See subversion revision 432.)

Refactored the code such that doPBSJob no longer has to be  
synchronized, it is instead throttled so a configurable number of job  
submissions can happen concurrently.  This makes the submission of  
several jobs at once much smoother, as they don't all block behind the  
same long lived critical section.  This change affects the the ICT  
Condor connector, the ICT PBS connector still requires further work to  
solve this issue.  The level of concurrency can be set by adjusting  
the max_concurrent_submits property in ICTCondor.properties.
(See subversion revision 429.)

Removed the need to spawn separate threads to read in the output from  
forked subprocesses.  This should result in faster more efficient  
execution for this module.  Change from using Runtime.exec to the more  
modern ProcessBuilder.
(See subversion revisions 427 and 428.)

Added the "-backwards" command line argument to condor_history calls,  
as this speeds up the lookups considerably on a systems which have a  
large history.  This is presumably as condor_history always iterates  
through the past jobs in order until it finds the one in question.  We  
are always interested in recent jobs, so this change makes sense.
(See subversion revision 425.)

Create and reuse a single instance of DefaultFileSystemManager for use  
with the ICT DRM connectors.  This fixes a significant resource leak  
issue.
(See subversion revision 424.)

Make the Condor submission file names and the shell used  
configurable.  These need to be configurable specifically in the case  
where the execution nodes are Windows rather then Unix.  The .origin  
files need to be named .bat and the #!/bin/sh line needs to be removed.
(See subversion revision 423.)

It is also designed to be used with OMII-UK's
- Campus Grid Toolkit 1.1.3
- Development Kit 3.4.4

These are available from www.omii.ac.uk
Support is available via su...@om...

Regards,
	Justin

--
Justin Bradley
Design & Development Team Leader
j.b...@om...
OMII-UK
Bay 23, 4067, B32
University of Southampton