[Pytables-users] Re: more on metadata

[Francesc A. <fa...@op...>]

A Dimarts 15 Juliol 2003 20:28, vareu escriure:
> To clarify the metadata idea.
>
> Because we can now target a specific part of the metadata rather than
> have to load in the entire set. One can just put a cache of the metadata
> in a group that is looked at.
>
> This makes "an" hdf_pickle even more accessible, since it is not costly
> to go through all of the keys and look for something. And if they decide
> to load up a group, you only load group  that you care about.
>

I think that before spending too much time implementing a metadata cache, it
would be worth to see how much this cache speeds up the creation of the
object tree. I don't remember whether you have reliable figures on that or
not.

In the case that it *significantly* improves the creation process, I think
that saving that in the same HDF5 file than data is an excellent idea. That
way, the portability of the pytables files will not suffer at all. And, of
course, I also like the idea of creating the cache in the group from where
the user wants to partially create the object tree (we can call that, say,
"user access points").


> john
>
>
> Portions of this message may be confidential under an exemption to Ohio's
> public records law or under a legal privilege. If you have received this
> message in error or due to an unauthorized transmission or interception,
> please delete all copies from your system without disclosing, copying, or
> transmitting this message.

-- 
Francesc Alted