What do you mean you have been able to program using Hyperterminal ?

Can you get it to autobaud with U, or do you mean you can set the baud rate yourself and send a serial data stream ?

I have problems with 38400 using a 20mhz xtal, but 57600 works fine (using FLIP and atmel t89c51rd2)