If the power supply is stable, thought maybe you were using batteries, I will have to ask if there is a load on the divider.

Other than that, I will have to guess that the pot becomes unstable with a little heat.

Why not use fixed resistors?