Maybe you could use an NPN transistor to drive the LED. 2N3904 or similar, with around 5.6k resistor to the base.

It'll keep the LED from pulling the voltage down.

_