[Perfparse-users] database size....

[James O. <jo...@re...>]

Hi all,
 
I sent an email to the list about a month ago on this issue and haven't
gotten a response.
 
I have perfparse and am tracking about 80 servers and about 10 or so
monitors per server, all running at five minute intervals.  I have 30 days
worth of data in the database.
 
Currently the perfdata_service_raw table is 45M rows and over 800M.  The
perfdata_service_bin table is 62M rows and about 1.6G (this is due to not
purging for a long time before I got the deletion policies working, I think
its about 900M of actual data).
 
Due to the number of rows the perfparse-db-purge actually crashes mysql due
to running out of buffer space... I have upped this to 16M and it still
crashes.
 
I'd also like to be able to monitor trends in services over a longer period
of time, like say the last month, the last year, the last 5 years similar to
the way mrtg does, but with the dataset the way it is that is currently not
feasible.  
 
How much data are other people retaining?  Has anyone else run into similar
issues?  Does anyone have a solution?
 
Thanks,
James