Is it a bad idea to use two of the pics you say are capable of maintaining one of the arrays?
I would think an 8 bit parallel interface between them could be that fast.
Definitely faster than SPI or I2C could do it.