That's strange. I'm not 100% of what i say but, looks like your programmer don't program the configuration bits for your device.

What's happening if you use a 20 MHZ oscillator and use HS mode???

what about now if you use a 4mhz and and use XT mode???