I unplug the USB cable to the programmer or disconnect the programmer completely from the Lab X1, touch the oscillator and the timing returns to normal speed!

Ok, so what can be the causes of something like this? This goes into capacitance stuff and that's over my head.