I did an extra test to confirm it wasn't another component on my main test board that was "messing up" the power.

I powered my isolated PIC with that DC-DC converter and sure enough ADC was jumping between 546 and 569 using my pot.

So now i have to find a 7805 variant that can supply 700mA without breaking a sweat.