Although I have not made anything on FPGA's I see them now as an approrpiate solution.

They can be really fast!

Now about the device, I could not find a detailed pdf. Only a 2-page short datasheet. Do you have a complete copy? From the short one I think it is not as fast as you have stated.

Ioannis