I do not have this chip but maybe you should do also this:

OSCCON1=%00000011
OSCCON2=%00000011

So you will have a 32MHz/8=4MHz

You also have the FCMEN_ON which means that if your main clock is not working you will be informed to do something.

Ioannis