Oh, and what's your power supply?

A speaker is a pretty low impedance load. Any chance that when the speaker turns on it drags your supply voltage down to unhappy levels?