First off, the pin is pulled high normally, and when the button is pushed, it goes low. I just typed it wrong :-)

I fixed the problem though, a MOV line
had the values backwards. I did it a little differently, but I will try your suggestions as well.