If you are sure its not keybounce then the other option is that the interrupt is generated when the switch inputs change states which is when they are closed and when they open again.So one when you press the key and one when you release it again.
I always use the max6818 for stuff like this.