I'm so stupid...
I didn't have the input pin set as input, works fine now