From: David R. <dav...@gm...> - 2013-07-28 14:22:20
|
maybe I wasn't aware of this, but has PANDAS completely wrapped PyTables, or is PyTables something I should still be using for storing and accessing scientific data, and PANDAS has an access point to it? On Sun, Jul 28, 2013 at 9:48 AM, Andreas Hilboll <li...@hi...> wrote: > Hi David, > > Am 28.07.2013 15:24, schrieb David Reed: > > Hi there, I was wondering if there any nice tutorials that show the > > different compression options such as zlib, bzo, etc. and how to > > actually use them with my tables. > > > > There seems to be a lot of good information describing the performance > > increase under the Optimization Tips section, but I don't see any clear > > way of actually doing this. > > > > Maybe I'm missing something. > > Maybe you're missing this: > > http://pandas.pydata.org/pandas-docs/stable/io.html#compression > > The HDFStore constructor has a "complib" kwarg which you can use to set > the compression library. Also look at "complevel" to set the compression > efficiency. > > -- Andreas. > |