Chris,

PortB change interrupts usually refer to bits 4-7 only, which means you will be okay (from an excluding bit 0 point of view). What pic are you using?