No, the 50uS is the sampling time. If you happen to read your ADC at varying intervals(due to different paths of code execution), that affects the reading stability. Try to put the ADC read inside an ISR so that it reads at a constant rate. Then perhaps the coupling will break and get you stable readings.