Thank you all !
I will be using the internal clock for now on. But keeping the external in the design, just in case.