<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Hey folks,<div><br></div><div>Just an update to anyone listening, I got nrpe debug logging working for OSX. I checked into the source and noticed that any messages sent by the call to syslog with LOG_NOTICE, LOG_WARNING, or LOG_ERR as the first parameter were working fine but if the first param to syslog was LOG_DEBUG I never saw that message. So I changed all calls to syslog with LOG_DEBUG as first param to use LOG_WARNING as first param instead. Re-compiled nrpe and moved the binary in place (/usr/local/nagios/bin) and bounced nrpe and now I'm seeing all those lovely log messages from nrpe. </div><div><br></div><div>w00t!</div><div><br></div><div>kyle</div><div><br><div><div>On May 22, 2009, at 6:36 AM, Kyle Smith wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Hey Philip,<div><br></div><div>Thanks for sending the log messages you see with debug enabled. I wish I was seeing the same but all I see are the startup and shutdown msgs with debug enabled (already pasted into this thread). It's frustrating since we have a few nrpe issues here and if I could get nrpe to tell me what it is doing I would have more of a foothold to resoluion. As it is I am bouncing nrpe weekly on one machine and daily on another just to keep things running, arg. </div><div><br></div><div>kyle</div><div><br><div><div>On May 21, 2009, at 11:07 AM, Philip Marcus wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite">Hey Kyle,<br><br>top-posting for laziness. :)<br><br>Here's an example of the output I am seeing in my log file after enabling debug logging in the NRPE config.<br><br>May 20 18:08:08 host1 nrpe[12854]: Connection from XXX.XXX.XXX.XXX port 31457<br> May 20 18:08:08 host1 nrpe[12854]: Host address is in allowed_hosts<br>May 20 18:08:08 host1 nrpe[12854]: Handling the connection...<br>May 20 18:08:08 host1 nrpe[12854]: Host is asking for command 'check_swap' to be run...<br> May 20 18:08:08 host1 nrpe[12854]: Running command: /usr/local/nagios/libexec/check_swap -w 30 -c 20<br>May 20 18:08:08 host1 nrpe[12854]: Command completed with return code 0 and output: SWAP OK - 100% free (15257 MB out of 15257 MB) |swap=15257MB;0;0;0;15257 <br> May 20 18:08:08 host1 nrpe[12854]: Return Code: 0, Output: SWAP OK - 100% free (15257 MB out of 15257 MB) |swap=15257MB;0;0;0;15257<br>May 20 18:08:08 host1 nrpe[12854]: Connection from XXX.XXX.XXX.XXX closed.<br><br>When debug logging is disabled I don't see any of this.<br> You should definitely see those messages on a successful attempt.<br><br>On the unsuccessful attempts, if you don't see any connection attempts, it may be a network issue.<br>You can run tcpdump on each host and see where the breakdown in communication may be.<br> <br>Good luck,<br><br>Philip<br><br><br><br><div class="gmail_quote">On Thu, May 21, 2009 at 7:59 AM, Kyle Smith <span dir="ltr"><<a href="mailto:kyles@apple.com">kyles@apple.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"> <div style="">Hey Philip,<div><br></div><div>Thanks for the response, see my comments inline...<br><div><div class="im"><div>On May 20, 2009, at 6:09 PM, Philip Marcus wrote:</div><br><blockquote type="cite">Hey Kyle,<br> <br>I'm just throwing out some random ideas off the top of my head...<br>To test, I just enabled debug in one of my nrpe configs, restarted the process and did see more output from the daemon.log file in my /var/log dir. (running ubuntu)<br> Do you see any output from nrpe? you should see a startup and stop message. If not, check the logging facility, and Stop/Start the nrpe daemon again.</blockquote><div><br></div></div>Yes I see nrpe messages for startup and shtudown of the daemon in my system log file (I'm on OSX so logfile is /var/log/system.log). My issue is that I don't see any more messages with debug enabled than I do with debug disabled. This is hampering my ability to work this issue since i can't tell what nrpe is doing internally. Here's a snippet of the logging I see for a shutdown and restart of nrpe on my host manta. As part of the startup logging it tells me I have configrued nrpe to accept command args which is accurate...</div> <div><br></div><div>May 21 07:55:30 manta nrpe[10200]: Caught SIGTERM - shutting down...</div><div>May 21 07:55:30 manta nrpe[10200]: Cannot remove pidfile '/var/run/nrpe.pid' - check your privileges.</div><div>May 21 07:55:30 manta nrpe[10200]: Daemon shutdown</div> <div>May 21 07:55:33 manta sudo[11969]: kylesmith : TTY=ttys000 ; PWD=/Users/kylesmith ; USER=root ; COMMAND=/usr/local/nagios/etc/init.d/init-script start</div><div>May 21 07:55:33 manta nrpe[11971]: Starting up daemon</div> <div>May 21 07:55:33 manta nrpe[11971]: Warning: Daemon is configured to accept command arguments from clients!</div><div> </div><div><div class="im"><blockquote type="cite"><br><br>Regarding the problem where after a while the remote check fails, thats a difficult one to pin down. It sounds like something is timing out. Without knowing anything about your environment or what the actual check is doing..., but it sounds like maybe some local disk access is timing out (I've seen this with kerberized NFS.), maybe some other local environment setting or keyring or something is expiring. When you login (as which ever user), you get a fresh "cert" and the command works, but the cert the existing process is running under has timed out. Like I said, just a stab in the dark.</blockquote> <div><br></div></div>I understand what you are getting at and I will investigate such possibilities. <br><blockquote type="cite"><br> <br>Good luck,</blockquote><div><br></div>Thanks again! >bows deeply<</div><div><br> </div><font color="#888888"><div>kyle</div></font><div><div></div><div class="h5"><div><br><blockquote type="cite"><br><br>Philip <br><br><br><div class="gmail_quote">On Wed, May 20, 2009 at 3:56 PM, Kyle Smith <span dir="ltr"><<a href="mailto:kyles@apple.com" target="_blank">kyles@apple.com</a>></span> wrote:<br> <blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"> <div>Hey Nagios Folks,<div><br></div><div>We're seeing some strange behavior with a few of our nrpe plugins and am wondering if anyone has any ideas on how to work on the problem.</div> <div><br></div><div>We are running OS X 10.5.6 with NRPE 2.12 and NRPE plugins 1.4.13.</div> <div><br></div><div>We have some plugins written in Ruby (boss loves it, I am learning it :-)) that work fine with a freshly started nrpe daemon. Start up nrpe on the client, force checks from the gui, see a green nagios console, nice. But after a while in the console under "Status Information" we start seeing "NRPE: unable to read output" rather than our normal success messages. Bounce the nrpe on the client, force the check through the gui, and things start working again for a while. </div> <div><br></div><div>While seeing the errors I can still run the plugin on the client no problem but when I try to run it from the server via command line (/usr/local/nagios/libexec/check_nrpe -H IP.of.client -c command) I see the error "NRPE: unable to read output".</div> <div><br></div><div>Another data point - We have one system where things were working fine but we needed to start passing params to nrpe. I recompiled after running ./configure --enable-command-args and setting dont_blame_nrpe=1 in the nrpe.cfg. Start up a new nrpe and it works fine, can pass params from the server no problem...but the a check that was working fine for weeks starts throwing<span style="font-family: Verdana; font-size: 13px;"> "<span style="font-family: Helvetica; font-size: 14px;">NRPE: unable to read output" after 3 or 4 successful invocations. Arg!! I had to rollback to the previous nrpe and check_nrpe.</span></span></div> <div><br></div><div>I am trying to set nrpe debug on in nrpe.cfg on the client and then bounce nrpe but i don't see any more messages in /var/log/system.log as compared to when I run with nrpe debug turned off. It's like turning on debug has no effect. </div> <div><br></div><div>I am curious about 2 issues - 1) why no extra messages in the system log file with debug enabled? and 2) Anyone seen anything like this happening where nrpe plugins work fine for a while then start throwing the error?</div> <div><br></div><div>TIA</div><div><br></div><font color="#888888"><div>kyle </div><div><br></div><div><br></div></font></div><br>------------------------------------------------------------------------------<br> Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT<br> is a gathering of tech-side developers & brand creativity professionals. Meet<br> the minds behind Google Creative Lab, Visual Complexity, Processing, &<br> iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian<br> Group, R/GA, & Big Spaceship. <a href="http://www.creativitycat.com" target="_blank">http://www.creativitycat.com</a> <br>_______________________________________________<br> Nagiosplug-help mailing list<br> <a href="mailto:Nagiosplug-help@lists.sourceforge.net" target="_blank">Nagiosplug-help@lists.sourceforge.net</a><br> <a href="https://lists.sourceforge.net/lists/listinfo/nagiosplug-help" target="_blank">https://lists.sourceforge.net/lists/listinfo/nagiosplug-help</a><br> ::: Please include plugins version (-v) and OS when reporting any issue.<br> ::: Messages without supporting info will risk being sent to /dev/null<br> <br></blockquote></div><br> ------------------------------------------------------------------------------<br>Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT<br> is a gathering of tech-side developers & brand creativity professionals. Meet<br>the minds behind Google Creative Lab, Visual Complexity, Processing, & <br>iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian<br> Group, R/GA, & Big Spaceship. <a href="http://www.creativitycat.com" target="_blank">http://www.creativitycat.com</a> _______________________________________________<br>Nagiosplug-help mailing list<br><a href="mailto:Nagiosplug-help@lists.sourceforge.net" target="_blank">Nagiosplug-help@lists.sourceforge.net</a><br> <a href="https://lists.sourceforge.net/lists/listinfo/nagiosplug-help" target="_blank">https://lists.sourceforge.net/lists/listinfo/nagiosplug-help</a><br>::: Please include plugins version (-v) and OS when reporting any issue. <br> ::: Messages without supporting info will risk being sent to /dev/null<br></blockquote></div><br></div></div></div></div><br>------------------------------------------------------------------------------<br> Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT<br> is a gathering of tech-side developers & brand creativity professionals. Meet<br> the minds behind Google Creative Lab, Visual Complexity, Processing, &<br> iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian<br> Group, R/GA, & Big Spaceship. <a href="http://www.creativitycat.com" target="_blank">http://www.creativitycat.com</a> <br>_______________________________________________<br> Nagiosplug-help mailing list<br> <a href="mailto:Nagiosplug-help@lists.sourceforge.net">Nagiosplug-help@lists.sourceforge.net</a><br> <a href="https://lists.sourceforge.net/lists/listinfo/nagiosplug-help" target="_blank">https://lists.sourceforge.net/lists/listinfo/nagiosplug-help</a><br> ::: Please include plugins version (-v) and OS when reporting any issue.<br> ::: Messages without supporting info will risk being sent to /dev/null<br> <br></blockquote></div><br> ------------------------------------------------------------------------------<br>Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT<br>is a gathering of tech-side developers & brand creativity professionals. Meet<br>the minds behind Google Creative Lab, Visual Complexity, Processing, & <br>iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian<br>Group, R/GA, & Big Spaceship. <a href="http://www.creativitycat.com">http://www.creativitycat.com</a> _______________________________________________<br>Nagiosplug-help mailing list<br><a href="mailto:Nagiosplug-help@lists.sourceforge.net">Nagiosplug-help@lists.sourceforge.net</a><br><a href="https://lists.sourceforge.net/lists/listinfo/nagiosplug-help">https://lists.sourceforge.net/lists/listinfo/nagiosplug-help</a><br>::: Please include plugins version (-v) and OS when reporting any issue. <br>::: Messages without supporting info will risk being sent to /dev/null<br></blockquote></div><br></div></div>------------------------------------------------------------------------------<br>Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT<br>is a gathering of tech-side developers & brand creativity professionals. Meet<br>the minds behind Google Creative Lab, Visual Complexity, Processing, & <br>iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian<br>Group, R/GA, & Big Spaceship. <a href="http://www.creativitycat.com">http://www.creativitycat.com</a> _______________________________________________<br>Nagiosplug-help mailing list<br><a href="mailto:Nagiosplug-help@lists.sourceforge.net">Nagiosplug-help@lists.sourceforge.net</a><br>https://lists.sourceforge.net/lists/listinfo/nagiosplug-help<br>::: Please include plugins version (-v) and OS when reporting any issue. <br>::: Messages without supporting info will risk being sent to /dev/null<br></blockquote></div><br></div></body></html>