Well all i can say, using the PLL the difference is 24MHZ. The problem would be the same with some I2C device at high SCL frequency. Some datasheet will suggest 1.8K for high frequency and 4.7K for lower frequency.