Do all you can to prevent timing on the controller.
Make use of an FPGA/CPLD that interfaces the leds. This way you avoid any pain of your programcoding!
Be sure to calculate the need of refreshment by using a matrix solution!!! You'll be suprised when you are using a lot of leds .....


Bert regards.