This has been my problem with using the internal OSC.
From the link Joe gave:
Applications that are exposed to a varying
voltage and temperature range could have
intelligent on-board recalibration.
I can make it work in the shop, but when it goes out into the world of 120 degrees F in the shade things get weird again. A three legged resonator does not have a problem.

Maybe I am missing something?