PORTA.5 is an external oscillator pin, and the default configuration is for the HS oscillator.
Changing the OSCCON register to use the internal oscillator does not free the external oscillator pins.

You'll need to set the configuration bits for the internal oscillator to be able to use those two pins.