[Pytables-users] Balance chunksize in large tables

[nikola s. <nid...@gm...>]

*Hi everyone, *

I'm new member and it's nice to meet you all.
I need some advices about my work with pytables. The problem is next. I'm
working on some kind of database using pytables and of course hdf5 format.
I created table with *six columns, row size 92B*. One column in table is
Time32Col. This column will be *indexed*. Table *will be updated* every
couple days (rows will be appended on existing table). *Between every
update users can create queries on table and consume data*. My question is
how efficiently balance chunksize between updates, because numbers of rows
in table will be start from *0 to 10 000 000 000* during the time? After
this number I will start archiving process, i.e. for example remove first
five billions rows and store in some other table for archiving. Of course,
I need this balance because *reading speed*. So, what is most efficient way
for setting chunksize for my problem? Sorry for my english.

*
Thanks for advice guys.
Cheers!
Nikola*