Yes, if you don't need them at the same time. You only need some external logic to switch between the two connections.

Another sollution would be to add a MAX3100 to your system. This is an SPI UART made by maxim.
Look at www.maxim-ic.com for details and a free sample.