Hi, I figured out what the problem was. One of the tracks on the PCB wasnt connecting properly which meant the PIC didnt have ground at all so it was getting its ground through the LEDs that were off.

Sorry to bother you all and thanks for helping