The internal oscillator runs at 500 Khz on power-up, which is 1/64th the 32 Mhz PBP is expecting.
So if you put it before the OSCCON statement, it will be equivelent to PAUSE 6400 or 6.4 seconds.

I'll try it on some real hardware tomorrow.