OSCCON only affects the internal oscillator.

With a 20Mhz crystal and the default configuration bits, the processor will be running at 48Mhz.

DEFINE OSC 48