Doh, I think I figured it out. Looks like RA3 can only be configured as an input.