Now that I think about it...

Even if the pins were high impedance while powered down, the way I had wanted to supply ground (LOW) to light the LED would not have worked because when I wanted to turn the LED off, by making the pin HIGH, that HIGH (5 V) would still have been lower (with respect to the +12V) and so the LED would have seen +7v across it.

Back to the drawing board