Re: Fwd: Re: [Pytables-users] Danger of file corruption?

[Norbert N. <Nor...@gm...>]

Sounds like a fundamental flaw in the design of HDF5 - a high-end data-storage 
system like HDF5 without protection against file corruption sounds 
unbelievable to me.

The argument that this is the same for any kind of file-storage does not hold 
here: I you use a journalled filesystem, you know that basic write operations 
are atomic. Based on that, it is possible with some care to design a 
file-format and protocol of writing that leaves the file in a well-defined 
state at any moment.

If, in HDF5, the basic operations are not atomic in the same sense, it will 
never be possible to build a secure system on top of it.

Writing additional copies of the file every now and then is, of course, a 
solution, but it really destroys all the benefits from the high-performance 
file format HDF5...

On Thursday 30 September 2004 17:02, Francesc Alted wrote:
> Someone at the list of HDF5 has answered. It looks like the danger of
> corruption is real. Matt suggest writing a number of dumps to avoid the
> worst to happen.
>
> Cheers,

-- 
_________________________________________Norbert Nemec
        Altdorfer Str. 9a ... D-93049 Regensburg
    Tel: 0941 / 2009638 ... Mobile: 0179 / 7475199
           eMail: <No...@Ne...>