Re: [Pytables-users] Pytables file structure

[Anthony S. <sc...@gm...>]

Hello Juan,

Try using the where() method [1],  It has a lot of nice features under the
covers.

Be Well
Anthony

1.
http://pytables.github.com/usersguide/libref.html?highlight=where#tables.Table.where

On Sun, Jul 15, 2012 at 4:01 PM, Juan Manuel Vázquez Tovar <
jmv...@gm...> wrote:

> Hello,
>
> I have been using pytables for a few moths. The main structure of my files
> has a four column table, two of which have multidimensional cells, (56,1)
> and (133,6) respectively. The previous structure had more columns instead
> of storing the 56x1 array into the same cell. The largest file has almost
> three million rows in the table.
> I usually request data from the table looping through the entire table and
> getting for each row one specific row of the 133x6 2d array.
> Currently, each of the requests can take from 15 sec up to 10 minutes, I
> believe that depending on the status of the office network.
> Could you please advice about how to improve the reading time?
> I have tried to compress the data with zlib, but it takes more or less the
> same time.
>
> Thanks in advance,
>
> Juan Manuel
>
>
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> _______________________________________________
> Pytables-users mailing list
> Pyt...@li...
> https://lists.sourceforge.net/lists/listinfo/pytables-users
>
>