We currently have nagios running without state retention, such that when it starts it requeues all service checks. At this moment this is the method we wish to use for a number of reasons.
Every time we restart Nagios all of the service checks in the web gui get set to “pending”. Over time, each is checked and has a proper status. However, every time we restart nagios we see some service checks that state that the service check is scheduled to be performed at a certain time, but that time is in the past, as if nagios failed to execute the service check when it was scheduled. The result is that nagios never starts performing checks on that service. The only way to get it to start checking the service is to manually queue it. From that point on it rechecks the service properly.
Has this ever happened to anyone else? Why do you suppose nagios has the service check scheduled, but never performs it?