I don't know how people can compare players/coaches accountability to refs it the were to be forced to give interviews. A coach or a player can lie to the journalist, use bad faith or belittle the journalist to get out of an interview, a ref wouldn't have this option or this would be ridiculous. Can you imagine a ref Mourinhoing his way out of an interview? "I refereed 3 champion's league final, why are you talking to me?"
A ref cannot just rally fans behind him to have support for the next game, he doesn't have pundits who used to play with him in support, he'll be alone and wil get slaughtered.
Mic them up, it'll already be far enough.