Of course you must correct this behaviour first of all.
However, you should also implement a safe strategy based on refreshing the values loaded into the latch periodically. This prevents an esporadic interference to convert into a permanent (latched) error. The exact period you must use in the refresh cycle, depends on what are you using the latch outputs for.

Alfredo.