Aha, 20mHz - there's your proplem...just kidding - you mean 20MHz ;-)

Did you use the same PCB, same resonator and everthing else and ONLY swapped the PIC when 4 out of 10 didn't work? Or was it actually 4 out of 10 boards that didn't work?
Datasheet for the specific resonator you're using? Short of that, measure the actual bit-time generated to verify at which frequency the PIC is ACTUALLY running.

/Henrik.