I've never had a problem using the internal oscillator, just keep in mind that it's an RC oscillator, so it doesn't have the same accuracy as an external crystal will (even if you use the trim settings cause it will drift some over temp).

That said, it's a very good oscillator design, and unless my numbers show me I really need the higher accuracy, I go for the internal RC.