I have a Tri-T graphic display (132 x 32) using the serial interface. Filling the screen and clearing it is almost instant with a 8mHz PIC. You should have no trouble using the SPI interface especially if you are updating only part of the screen.

Phil