Yes the clock & data pins definitely matter if you program in-circuit. A load on the clock pin in particular will really mess with timing.

Read Microchips' DS91017B ICSP guide for a detailed explanation.