They are required as part of the timing circuit - take a read of page 9 of the PBP manual.

You can't simply place a crystal between the two pins, it needs to oscillate and these caps between GND and the pins are required to make the thing resonate

http://en.wikipedia.org/wiki/Crystal_oscillator