Micro,
Maybe your solution is working but will Behave weird one day or another.

I've nothing else to add from the Bruce's explanation. Everything is covered in his document.

AND it's also covered in the PORTB TRISB section 3.2 of your datasheet too.

BTW, why using interrupt on PORTB<7:4> if you never test wich pin gives you the interupt?