The pull-up resistor I am using is 6K and I do have a capacitor over the power pins.

I have gotten it to work by accident when it was programmed for an internal oscillator but the crystal and capacitors were still hooked up from when I was trying an external mode. It started working when I touched one of the capacitors off the crystal, I put it on the scope and the timing was right. It was like the extra capacitance kicked it off or something? Only sometimes this works and it doesn’t work when I set it to external mode. It makes me think it is a configuration problem but I’ve tried everything I can think of