Just to be sure, I just added another 0.1uF cap directly across the supply pins of the pic and it didnt help.

I've also turned off MCLR, but also no luck.

I've also just tried replacing the PIC but same issue.

I'm stumped.