Re: [Pytables-users] Performance of tables vs. arrays (out vs in core?)

[Alvaro T. C. <al...@mi...>]

Hi,

I tried again, also with different chunklens and couldn't reproduce it.
Unfortunately the session where I had this result was killed by a power
outage and the history buffer does not go as far back, so I can't find out
what exactly triggered it.


-á.


On Thu, Apr 26, 2012 at 04:10, Francesc Alted <fa...@py...> wrote:

> On 4/25/12 6:13 AM, Alvaro Tejero Cantero wrote:
> > Hi,
> >
> > Thanks for the clarification.
> >
> > I retried today both with a normal and a completely sorted index on a
> > a blosc-compressed table (complevel 5) and could not reproduce the
> > putative bug either.
>
> So could you please confirm if you can reproduce the problem with blosc
> level 9?
>
> Thanks!
>
> >
> > -á.
> >
> >
> > On Tue, Apr 24, 2012 at 04:39, Anthony Scopatz<sc...@gm...>
>  wrote:
> >> On Mon, Apr 23, 2012 at 9:14 PM, Francesc Alted<fa...@py...>
>  wrote:
> >>> On 4/19/12 8:43 AM, Alvaro Tejero Cantero wrote:
> >>>> Some complementary info (I copy the details of the tables below)
> >>>>
> >>>> timeit vals = numpy.fromiter((x['val'] for x in
> >>>> my.root.raw.t0.wtab02.where('val>1')),dtype=np.int16)
> >>>> 1 loops, best of 3: 30.4 s per loop
> >>>>
> >>>>
> >>>> Using the compressed and indexed version, it mysteriously does not
> >>>> work (output is empty list)
> >>>>>>> cvals = np.fromiter((x['val'] for x in wctab02.where('val>1')),
> >>>>>>> dtype=np.int16)
> >>>>>>> cvals
> >>>> array([], dtype=int16)
> >>> This smells like a bug, but I cannot reproduce it.  Could you send an
> >>> self-contained example reproducing this behavior?
> >>
> >> I am not able to reproduce this either...
> >>
> >>>
> >>> --
> >>> Francesc Alted
> >>>
> >>>
> >>>
> >>>
> ------------------------------------------------------------------------------
> >>> Live Security Virtual Conference
> >>> Exclusive live event will cover all the ways today's security and
> >>> threat landscape has changed and how IT managers can respond.
> Discussions
> >>> will include endpoint security, mobile security and the latest in
> malware
> >>> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> >>> _______________________________________________
> >>> Pytables-users mailing list
> >>> Pyt...@li...
> >>> https://lists.sourceforge.net/lists/listinfo/pytables-users
> >>
> >>
> >>
> ------------------------------------------------------------------------------
> >> Live Security Virtual Conference
> >> Exclusive live event will cover all the ways today's security and
> >> threat landscape has changed and how IT managers can respond.
> Discussions
> >> will include endpoint security, mobile security and the latest in
> malware
> >> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> >> _______________________________________________
> >> Pytables-users mailing list
> >> Pyt...@li...
> >> https://lists.sourceforge.net/lists/listinfo/pytables-users
> >>
> >
> ------------------------------------------------------------------------------
> > Live Security Virtual Conference
> > Exclusive live event will cover all the ways today's security and
> > threat landscape has changed and how IT managers can respond. Discussions
> > will include endpoint security, mobile security and the latest in malware
> > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> > _______________________________________________
> > Pytables-users mailing list
> > Pyt...@li...
> > https://lists.sourceforge.net/lists/listinfo/pytables-users
>
>
> --
> Francesc Alted
>
>
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> _______________________________________________
> Pytables-users mailing list
> Pyt...@li...
> https://lists.sourceforge.net/lists/listinfo/pytables-users
>