Try allowing D0 : D3 to float without grounding them and ground pin 3 of the LCD instead of the pot(I always do this).