You didnt mention it soooo, Do you have a pullup resistor on RA4?
Read PICmicro MCU specific Issues in the manual ( sect 2.5.1 )

Andrew