[Pytables-users] Re: Query Tests

[kevin l. <lke...@ya...>]

--- kevin lester <lke...@ya...> wrote:

OOps, Python 2.4 is the version

> Hi Francesc,
> 
> My apologies for not reciprocating to you a quick
> response.
> 
> > ...where the speed-up is clearly inferior. Just
> out
> > >of
> > curiosity, which processor, speed, and python
> version        >are you using?
> 
> I have a Pent4;WinXP;1G_DDR2;2.6GHz;800FSB. I
> provided
> a couple of tests below. These were only for queries
> though not 'file writes', and only a single run for
> each. 
> 
> The only radical difference I noticed was the page
> file usage as noted. The CPU ran between 50-54%
> consistently. Every other calib. on the Win task
> manager stayed approximately equal for each test. I
> do
> run into intermittent crashes (w/pytables) every
> once
> in a while, especially after a fresh reboot of Win. 
> 
> Finally, notice that the UserWarning message is
> always
> being displayed even though all comp. package dll's
> are in order.
> 
> Thank you.
> 
> Running 'C:\H5\klester.py' ...
> C:\Python24\lib\site-packages\tables\Leaf.py:90:
> UserWarning: zlib compression library is not
> available. Using zlib instead!.
>   warnings.warn( \
> 
> 
> File Size: 6.39M
> Nrows----> 100000*20cols
> Filters----> None
> Time for standard query--> 0.0620000362396
> Time for inkernel query--> 0.0469999313354
> Time for indexed query--> 0.0160000324249
> 
> File Size: 2.07M
> Nrows----> 100000*20cols
> Filters----> 'ZLIB'
> Time for standard query--> 0.139999866486
> Time for inkernel query--> 0.0940001010895
> Time for indexed query--> 0.0629999637604
> 
> File Size: 2.05M
> Nrows----> 100000*20cols
> Filters----> 'LZO'
> Time for standard query--> 0.0929999351501
> Time for inkernel query--> 0.0629999637604
> Time for indexed query--> 0.0469999313354
> 
> File Size: 2.04M
> Nrows----> 100000*20cols
> Filters----> 'UCL'
> Time for standard query--> 0.0940001010895
> Time for inkernel query--> 0.0780000686646
> Time for indexed query--> 0.0469999313354
> 
> File Size: 31.1M
> Nrows----> 500000*20cols
> Filters----> 'None'
> Time for standard query--> 0.358999967575
> Time for inkernel query--> 0.171999931335
> Time for indexed query--> 0.125
> 
> File Size: 10.1M
> Nrows----> 500000*20cols
> Filters----> 'ZLIB'
> Time for standard query--> 0.516000032425
> Time for inkernel query--> 0.375
> Time for indexed query--> 0.31299996376
> 
> File Size: 10.0M
> Nrows----> 500000*20cols
> Filters----> 'LZO'
> Time for standard query--> 0.43799996376
> Time for inkernel query--> 0.280999898911
> Time for indexed query--> 0.219000101089
> ***Notes: Page file usage more than doubled
> 
> File Size: 10.0M
> Nrows----> 500000*20cols
> Filters----> 'UCL'
> Time for standard query--> 0.484999895096
> Time for inkernel query--> 0.344000101089
> Time for indexed query--> 0.25
> ***Notes Page File usage nearly doubled
> 
> 
> 		
> __________________________________ 
> Do you Yahoo!? 
> The all-new My Yahoo! - What will yours do?
> http://my.yahoo.com 
> 


__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com