[Pytables-users] Pytables file structure

[Juan M. V. T. <jmv...@gm...>]

Hello,

I have been using pytables for a few moths. The main structure of my files
has a four column table, two of which have multidimensional cells, (56,1)
and (133,6) respectively. The previous structure had more columns instead
of storing the 56x1 array into the same cell. The largest file has almost
three million rows in the table.
I usually request data from the table looping through the entire table and
getting for each row one specific row of the 133x6 2d array.
Currently, each of the requests can take from 15 sec up to 10 minutes, I
believe that depending on the status of the office network.
Could you please advice about how to improve the reading time?
I have tried to compress the data with zlib, but it takes more or less the
same time.

Thanks in advance,

Juan Manuel