Re: [Perfparse-users] database size....

[Yves M. <yme...@li...>]

> I'm in a simular situation, but more servers....looking at about 600
> servers eventually, and I'd like to store about a year worth of data fo=
r
> post analysis, and trending.  What kind of storage am I going to need?
> I'm looking at 86mil rows inserted per month....ouch.  Also, has anyone
> every used Oracle with Perfparse?  What would be involved in writing it
> modular to use any database backend?

With next version 0.101.x, perfparse (the scanner, not the CGI) is enough=
 modular to let
you write your own database backend. If you want to contribute like that,=
 contact Ben or
I and we will explain you what to do to install and work on 0.101 (not re=
leased yet)

Yves

>
>
> On Tue, 28 Sep 2004 17:21:49 -0700, James Ochs <jo...@re...>
> wrote:
>
>> Hi all,
>> I sent an email to the list about a month ago on this issue and haven'=
t
>> gotten a response.
>> I have perfparse and am tracking about 80 servers and about 10 or so
>> monitors per server, all running at five minute intervals.  I have 30
>> days
>> worth of data in the database.
>> Currently the perfdata_service_raw table is 45M rows and over 800M.  T=
he
>> perfdata_service_bin table is 62M rows and about 1.6G (this is due to =
not
>> purging for a long time before I got the deletion policies working, I
>> think
>> its about 900M of actual data).
>> Due to the number of rows the perfparse-db-purge actually crashes mysq=
l
>> due
>> to running out of buffer space... I have upped this to 16M and it stil=
l
>> crashes.
>> I'd also like to be able to monitor trends in services over a longer
>> period
>> of time, like say the last month, the last year, the last 5 years
>> similar to
>> the way mrtg does, but with the dataset the way it is that is currentl=
y
>> not
>> feasible.
>> How much data are other people retaining?  Has anyone else run into
>> similar
>> issues?  Does anyone have a solution?
>> Thanks,
>> James
>
>
> -------------------------------------------------------
> This SF.net email is sponsored by: IT Product Guide on ITManagersJourna=
l
> Use IT products in your business? Tell us what you think of them. Give =
us
> Your Opinions, Get Free ThinkGeek Gift Certificates! Click to find out =
more
> http://productguide.itmanagersjournal.com/guidepromo.tmpl
> _______________________________________________
> Perfparse-users mailing list
> Per...@li...
> https://lists.sourceforge.net/lists/listinfo/perfparse-users
>
>


--=20
- Homepage    - http://ymettier.free.fr - http://www.logicacmg.com -
- GPG key     - http://ymettier.free.fr/gpg.txt                    -
- Maitretarot - http://www.nongnu.org/maitretarot/                 -
- GTKtalog    - http://www.nongnu.org/gtktalog/                    -