How about if you just monitor you reading on a LCD or Serial PC communication? Is there variation as it's suppose to have, or the results are just messy?

How about your ADC config?

How about the impedance of your POT? Must meet the maximum state in the datasheet...