Re: [Pytables-users] append to multiple tables

[Anthony S. <sc...@gm...>]

Hi Ed,

Are you inside of a nested loop?  You probably just need to flush after the
innermost loop.

Do you have some sample code you can share?

Be Well
Anthony


On Mon, Jun 10, 2013 at 1:44 PM, Edward Vogel <edw...@gm...>wrote:

> I have a dataset that I want to split between two tables. But, when I
> iterate over the data and append to both tables, I get a warning:
>
> /usr/local/lib/python2.7/site-packages/tables/table.py:2967:
> PerformanceWarning: table ``/cv2`` is being preempted from alive nodes
> without its buffers being flushed or with some index being dirty.  This may
> lead to very ineficient use of resources and even to fatal errors in
> certain situations.  Please do a call to the .flush() or .reindex_dirty()
> methods on this table before start using other nodes.
>
> However, if I flush after every append, I get awful performance.
> Is there a correct way to append to two tables without doing a flush?
> Note, I don't have any indices defined, so it seems reindex_dirty()
> doesn't apply.
>
> Thanks,
> Ed
>
>
> ------------------------------------------------------------------------------
> This SF.net email is sponsored by Windows:
>
> Build for Windows Store.
>
> http://p.sf.net/sfu/windows-dev2dev
> _______________________________________________
> Pytables-users mailing list
> Pyt...@li...
> https://lists.sourceforge.net/lists/listinfo/pytables-users
>
>