I can suggest to switch off everything when not used, so you will have no power drain. When you press any button to activate the proper command, you will switch on the system via a small fet activated with an array of diodes so that any button will switch on the fet. Your pic as activated will retain the fet on for all the time necessary to process the comand then it will switch off the fet again.

Cheers

Al.