Clear OSCCON.7 so you aren't in power managed mode with peripherals still clocked during sleep.