What are your configs set to? With LVP (low voltage programming) set to ON, it will behave badly at 5v. If it is on, set it to off.