Winson,

Simply connect the LCD to the parallel port.

http://www.beyondlogic.org/parlcd/parlcd.htm

You should be able to draw +5 from the port in the case of LCD, if it isn't LED backlit. LEDs on the other hand, draw a lot of current, so don't try and power them from the port. You may be able to derive power from the PC's power supply if LEDs are deemed necessary.

Cory Spackman