For months, I've been happily changing my nagios service configs without incident. Suddenly, the last change I made and restarted, nagios sometimes uses the new configuration and sometimes the old, it flipping back and forth between the two. What I've discovered is that, periodically, the status.dat file shows the old service definition, and then sometimes the new definition. I know that status.dat is periodically written by the nagios process and so to try to rememdy the problem, I've reconfig'ed nagios not to use retention data at all and blown away retention.dat, status.dat and objects.cache before restarting nagios. But, it STILL keeps happening.
So, my question is: Where else could nagios be getting the old config from?