I'll put money on the fact that you've not switched it into DIGITAL mode... PortE like PortA is muxed with the ADC...