The problem must be with moving the config data to the port.


Code:
 MOVLW B'00011110' ;Set RA<4:1> H
 BANKSEL LATA    
 MOVWF LATA