Yes, a stupid mosfet or even a cheap ass transistor could be the solution. Problem is, that I already have a PCB, and even with redesign really no space for extra components, not even a TO92...
So that's why I would like to fix this with just a piece of wire between the (now unused) pin RA4 and the buzzer.