Interrupts alone can cause seriously erratic behaviour depeding on your
program structure & how you're handling things getting in/out of the int
handler.

I would still look at isolation, but it may also have something to do with your
interrupts. Can you post your interrupt handler?