Hi Rolf!
I think your microcontroller should test i.e. SCL line. Or, maybe it is better, your masters should have ability to act as a slaves too. In this case, all devices should "listen" and only one can "talk" in the moment. It is near the same like talking through CB radio. You have to press the switch for receive and send modes, because you are working in simplex.

Jacek