Assuming your circuit, regulators, etc. can handle it (i.e. drop out voltages, etc), a couple of diodes could make it so that it wouldn't really matter if a person did plug the battery in backwards...but at the same time, ground would act a bit goofy since it would be offset just a bit.
Bookmarks