Guess I need a patch

This is what you need in the config line then
Code:
_INTRC_OSC_NOCLKOUT
Then look in the data sheet under the OSC section at the OSCON register.