Add a Toggle option for objects that allows you to make them invisible for a choosen player color or on the contrary to make them visible to everyone except for the choosen color.
You can use a simple scripting function to hide objects from specific players