Menu

Nagios 3.4.1 suddenly rrd data not created

Michael
2013-09-02
2013-09-09
  • Michael

    Michael - 2013-09-02

    Can anyone please help me with this issue? WE are running Nagios for a year now and suddenly the Nagiosgraph stop working. We get a Internel server error. We are monitoring 1433 host and we have 26000 service checks, is this to much? Our Primary server works fine but our secondary server (passive server) has this issue. The only thing is that we migrate the secondary server to another subnet. help me out!!

     
  • Michael

    Michael - 2013-09-03

    Secondary server /usr/local/nagios/etc/nagios.cfg

    begin nagiosgraph configuration

    process nagios performance data using nagiosgraph

    process_performance_data=1
    service_perfdata_file=/tmp/perfdata.log
    service_perfdata_file_template=$LASTSERVICECHECK$||$HOSTNAME$||$SERVICEDESC$||$SERVICEOUTPUT$||$SERVICEPERFDATA$
    service_perfdata_file_mode=a
    service_perfdata_file_processing_interval=30
    service_perfdata_file_processing_command=process-service-perfdata-for-nagiosgraph

    end nagiosgraph configuration

    /var/log/httpd/error.log
    [Mon Sep 02 17:27:18 2013] [warn] [client 10……..] Timeout waiting for output from CGI script /usr/local/nagios/sbin/status.cgi, referer: http://servername/
    [Mon Sep 02 17:27:34 2013] [warn] [client 10……..] Timeout waiting for output from CGI script /usr/local/nagios/sbin/status.cgi, referer: http:// servername /side.php
    [Tue Sep 03 00:37:04 2013] [warn] [client 10……….] Timeout waiting for output from CGI script /usr/local/nagios/sbin/status.cgi, referer: http:// servername /
    [Tue Sep 03 00:37:04 2013] [error] [client 10………] Premature end of script headers: status.cgi, referer: http://lsrv1391/
    [Tue Sep 03 00:37:15 2013] [warn] [client 10………] Timeout waiting for output from CGI script /usr/local/nagios/sbin/status.cgi, referer: http:// servername /side.php
    [Tue Sep 03 00:37:15 2013] [error] [client 10………] Premature end of script headers: status.cgi, referer: http://lsrv1391/side.php
    [Tue Sep 03 00:38:43 2013] [warn] [client 10………] Timeout waiting for output from CGI script /usr/local/nagios/sbin/showlog.cgi, referer: http:// servername /side.php
    [Tue Sep 03 00:38:43 2013] [error] [client 10……..] Premature end of script headers: showlog.cgi, referer: http://lsrv1391/side.php
    [Tue Sep 03 00:38:48 2013] [warn] [client 10……..] Timeout waiting for output from CGI script /usr/local/nagios/sbin/showlog.cgi, referer: http:// servername /side.php
    [Tue Sep 03 00:38:48 2013] [error] [client 10……..] Premature end of script headers: showlog.cgi, referer: http://lsrv1391/side.php
    [Tue Sep 03 00:39:04 2013] [warn] [client 10……..] Timeout waiting for output from CGI script /usr/local/nagios/sbin/status.cgi, referer: http:// servername /
    [Tue Sep 03 00:39:15 2013] [warn] [client 10……..] Timeout waiting for output from CGI script /usr/local/nagios/sbin/status.cgi, referer: http:// servername /side.php
    [Tue Sep 03 00:39:25 2013] [warn] [client 10………] Timeout waiting for output from CGI script /usr/local/nagios/sbin/status.cgi, referer: http:// servername /side.php
    [Tue Sep 03 00:39:25 2013] [error] [client] 10……..]Premature end of script headers: status.cgi, referer: http://lsrv1391/side.php
    [Tue Sep 03 00:40:43 2013] [warn] [client 10……….] Timeout waiting for output from CGI script /usr/local/nagios/sbin/showlog.cgi, referer: http:// servername /side.php
    [Tue Sep 03 00:40:48 2013] [warn] [client 10……….] Timeout waiting for output from CGI script /usr/local/nagios/sbin/showlog.cgi, referer: http:// servername /side.php
    [Tue Sep 03 00:41:25 2013] [warn] [client 10………..] Timeout waiting for output from CGI script /usr/local/nagios/sbin/status.cgi, referer: http:// servername /side.php

    ls -ltrd /var/nagios/rrd/
    drwxrwxr-x 3 nagios nagios 32768 Sep 2 16:34 /var/nagios/rrd/

    ls -ltrd /var/nagios/
    drwxrwxrwx+ 4 nagios nagios 4096 Sep 2 16:33 /var/nagios/

    getfacl /var/nagios
    getfacl: Removing leading '/' from absolute path names

    file: var/nagios

    owner: nagios

    group: nagios

    user::rwx
    user:apache:rwx
    group::rwx
    mask::rwx
    other::rwx

    Primary server /usr/local/nagios/etc/nagios.cfg

    begin nagiosgraph configuration

    process nagios performance data using nagiosgraph

    process_performance_data=1
    service_perfdata_file=/tmp/perfdata.log
    service_perfdata_file_template=$LASTSERVICECHECK$||$HOSTNAME$||$SERVICEDESC$||$SERVICEOUTPUT$||$SERVICEPERFDATA$
    service_perfdata_file_mode=a
    service_perfdata_file_processing_interval=30
    service_perfdata_file_processing_command=process-service-perfdata-for-nagiosgraph

    end nagiosgraph configuration

    ls -ltrd /var/nagios/
    drwxrwxr-x+ 4 root root 4096 Sep 3 04:02 /var/nagios/

    getfacl /var/nagios/
    getfacl: Removing leading '/' from absolute path names

    file: var/nagios

    owner: root

    group: root

    user::rwx
    user:apache:rwx
    group::r-x
    mask::rwx
    other::r-x

    ls -ltrd /var/nagios/rrd
    drwxr-xr-x 1469 nagios root 36864 Sep 2 16:38 /var/nagios/rrd

    ls -ltr /var/nagios/rrd|wc -l
    1468

     
  • Alan Brenner

    Alan Brenner - 2013-09-09

    What's different with the web server configuration: version, directory permissions, etc?

     

Log in to post a comment.