If it was me, I'd establish one single point as ground, probably the center pin of the LM7805. Then I'd check all the possible points on both boards with a multimeter to see if there's any DC bias. I agree that it sounds like something is wrong in the power distribution or grounding.