The parallel port pins are probably backfeeding the microcontroller power supply through the 8051 ESD diodes.

I don't know what the best solution is. I think that there are bus logic families that can tolerate high inputs while they are powered down, but I am not sure.

- Lee