Try sticking a large Cap across the power supply. To insure good filterization. Another thing... the MCLR pin...is it held high at one place and not the other? Or is it floating? If so, program it in the Define to stay high.

Dwayne