Not sure about this, but it is possible that the PIC is sinkink current through the 4.7K resistor even though the PIC is powered off. Can we see the whole schematic?

Robert