Try to change all ports to inputs before entering sleep.
With 18F4520 I can see big difference if I don't do that (~2mA vs 200uA, incl. quiescent current of the regulator).
After sleep change ports back to normal settings before executing next steps.
Also disable pull-ups and use external pull-up with power sw.
Bookmarks