Might be drawing more current or introducing noise into the circuit. I had a problem like this once and remedied it by placing a capacitor between 5V and common.