[Nagiosplug-devel] .cgi Problem

[Olaf Ridder]

Dear All,

after installing Nagios 3.01 on a new installed VM-machine with Suse 10.3 I 
took my older config files from Nagios 2.10 and copy them to 3.01 installation.
The first 20 - 30 minutes everything seems to be ok. Nagios is working and 
websites are shown.
Then suddenly the following error occurs:


Serverfehler!

Die Anfrage kann nicht beantwortet werden, da im Server ein interner Fehler 
aufgetreten ist. 

Fehlermeldung: 
Premature end of script headers: status.cgi 

Sofern Sie dies für eine Fehlfunktion des Servers halten, informieren Sie 
bitte den Webmaster hierüber. 
Error 500
(sorry for the german message)

Apache logs the following entry:

[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] *** glibc detected 
*** /usr/lib/nagios/cgi/status.cgi: malloc(): memory corruption: 0x080b0678 
***, referer: http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] ======= Backtrace: 
=========, referer: http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] /lib/libc.so.6
[0xb7e134b6], referer: http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] /lib/libc.so.6
[0xb7e15701], referer: http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] /lib/libc.so.6
(__libc_malloc+0x97)[0xb7e16d07], referer: http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 
172.20.11.144] /usr/lib/nagios/cgi/status.cgi[0x8056b1b], referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 
172.20.11.144] /usr/lib/nagios/cgi/status.cgi[0x807167c], referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 
172.20.11.144] /usr/lib/nagios/cgi/status.cgi[0x8057c3a], referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 
172.20.11.144] /usr/lib/nagios/cgi/status.cgi[0x8053fd7], referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] /lib/libc.so.6
(__libc_start_main+0xe0)[0xb7dc2fe0], referer: http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 
172.20.11.144] /usr/lib/nagios/cgi/status.cgi[0x80491f1], referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] ======= Memory map: 
========, referer: http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] 08048000-08080000 r-
xp 00000000 08:02 1284591 /usr/lib/nagios/cgi/status.cgi, referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] 08080000-08081000 r--
p 00037000 08:02 1284591 /usr/lib/nagios/cgi/status.cgi, referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] 08081000-08082000 rw-
p 00038000 08:02 1284591 /usr/lib/nagios/cgi/status.cgi, referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] 08082000-0818c000 rw-
p 08082000 00:00 0 [heap], referer: http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] b7b00000-b7b21000 rw-
p b7b00000 00:00 0 , referer: http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] b7b21000-b7c00000 ---
p b7b21000 00:00 0 , referer: http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] b7c54000-b7c5e000 r-
xp 00000000 08:02 279177 /lib/libgcc_s.so.1, referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] b7c5e000-b7c60000 rw-
p 00009000 08:02 279177 /lib/libgcc_s.so.1, referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] b7c60000-b7d81000 r--
p 00000000 08:02 1561180 /var/lib/nagios/status.dat, referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] b7d81000-b7d82000 rw-
p b7d81000 00:00 0 , referer: http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] b7d82000-b7dab000 r-
xp 00000000 08:02 647480 /usr/lib/libpcre.so.0.0.1, referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] b7dab000-b7dad000 rw-
p 00028000 08:02 647480 /usr/lib/libpcre.so.0.0.1, referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] b7dad000-b7eda000 r-
xp 00000000 08:02 279084 /lib/libc-2.6.1.so, referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] b7eda000-b7edb000 r--
p 0012c000 08:02 279084 /lib/libc-2.6.1.so, referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] b7edb000-b7edd000 rw-
p 0012d000 08:02 279084 /lib/libc-2.6.1.so, referer: 
http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] b7edd000-b7ee0000 rw-
p b7edd000 00:00 0, referer: http://172.20.11.96/nagios/
[Mon Apr 21 10:07:24 2008] [error] [client 172.20.11.144] , referer: 
http://172.20.11.96/nagios/


There is no influence by restarting apache or Nagios. The situation still is 
the same with the error.
I only found one procedure to get back the websites:
- stop Nagios
- delete retention.dat file (or copy an older version to it)
- start Nagios

Unfortunately this error occurs again after a timeperiod smaler than 1 hour.

Has anybody an idea?

Thanks,
Olaf