To be honest, if people started to do that, we'd end up reaching the point where mods would toss people out for even the flimsiest of excuses.

I would rather have people come to me and let me know that what they're doing is making them uncomfortable than tossing them on a whim.