The main pic gets alway's 5 volt or did you make an other circuit than I drew?
Or your 7805 is broken. or your main supply is not strong enough.
Or did you build sommething else. if so please let me see the drawing then.