From: Joe Mellon <joe.mellon@gm...> - 2005-01-26 00:13:56
I recently got and integrated the code from Dave Little of UCSD around
generalising the connection to storage. This allows existing file
systems or other storage mechanisms (UCSD uses an SRB) to be used as
well as the DSpace file system abstraction.
I think he did a good job on this - absolutely minimal, well commented
changes to DSpace, and it doesn't break, and lives happily with, the
existing mechanism. For me it integrated, compiled and ran first time
without problem. While he uses a connection to an SRB (storage request
broker), I am just using the normal file system.
He introduces the concept of "registration": a file is "registered" to
DSpace - the file location is specified, the meta data is specified and
imported. (I will be integrating it into interactive submission
processes for very large video files).
I am not near the DSpace development effort, but I think the changes
should definitely be incorporated in the mainline - it breaks nothing
and generalises the connection to storage.
Also I think the paradigm of loading over the browser is not correct for
large (eg video) files. A hi-res video of a teaching event lasting say 2
hours produces for us 5 Gb. (Possibly also not too uncommon for many
scientific research areas - astronomy, medicine, though I am not in such
These can't be loaded over the browser. In fact, although the
theoretical limit over a browser is about 2 Gb, and the DSpace default
is a limit of 500 Mb, I found the practical limit before something would
time out was about 70 Mb, which for a hi-res video is tiny. So for a
digital archive looking forward, something like this change will be
required: I imagine in a few years terabyte media files are thinkable.
There have also been discussions around the DSpace file system
abstraction on the list.... our people were unhappy that a systematic
error or blow up in DSpace could reduce what they have now, something
to a vast collection of unsorted files with names like
Hope this helps
+49 (0)89 625 6334