that might be just it:
From the datasheet:
Note: The ANSEL register must be initialized to
configure an analog channel as a digital
input. Pins configured as analog inputs will
read ‘0’.

But it also says the same for ANSELH, should I but both of them to 0 ??