The OSC frequency doesn't directly affect or interfere with interrupts.

Your original program was set up for 4Mhz, so any change in OSC frequency could affect the way your program handles the interrupts.

The main thing is selecting the correct oscillator mode (XT, HS) for your crystal.