What about the voltage regulator? Is it heating up after a bit and dropping out?.

A schematic might help.