I'm not picking on you Gogf, this opinion has been expressed by many people now.
So let's say we allowed a vote in OT twice a year to get rid of one poster and required at least 50% of the vote for one person to have them banned form OT. I've just re-read the survey results and even though we didn't ask the question specifically quite a few of those who replied did suggest banning of someone. Not one poster received over 1/3 of the vote.
I know most of you have a couple of obvious candidates of you'd like to get rid of, and because they are so obvious to you (generic you), you presume the list is the same for everyone. That's just not the case. Different people are annoyed by different things and are understanding of different things.
That is one of the reasons why "being annoying" isn't against the rules any more than "being stupid" is.
And in case you were wondering, if the staff had the vote, the candidates wouldn't even come from OT