A couple of resistors maybe are enough to isolate the ICSP from the rest of the circuit without need of any jumpers.

Ioannis