Re: [Iamb-dev-internal] streed

[Rich B. <rb...@rc...>]

Matt Cashner wrote:
> 
> the decision i've made for the internals of the stree daemon is to store
> the strees in an internal hash ref. then every n seconds a snapshot of
> that internal queue will be taken and written to the
> database. modification of the hash should be fast enough to avoid data
> collisions (extensive testing will verify this). i'm probably going to
> need another process to farm off the database saving too. DBI blocks IO
> and as such, while DBI is doing a insert or whatever, the whole server has
> to sit and spin until the IO is done. very silly and very nasty. and if we
> plan on this being used in a high traffic situation, that sort of blocking
> could be very ugly indeed. any thoughts folks?

Is this DBI's fault, or the particular DBD that we happen to be using?
Would another database alleviate this problem? (I seem to recall that
this is DBI, but I was not sure.)

But, yes, it would be pretty cool to have a dbi cache thingy that you
send data to, and it queues up inserts/updates for later processing.
This could be a very cool thing just of itself - that is, completely
apart from IAMB.

-- 
Rich Bowen <rb...@rc...>
Come see me at Apachecon! -- http://www.apachecon.com/