4MHz is border line for 9600 baud. That is mentioned in the manual.

Other problems could be in your code. You need to post it so the GSM guys can see what you are doing.