I would guess that you have taken too big a byte, by using a compiler you are not familiar with, and a new chip that you are not familiar with, and is not proven to be good. I have used SDCC and it works fine with normal serial (non-ir).