Use portb and you can use the internal pullups.
It really only matters if you are using the pins for multiple functions.