I agree that it should be an issue for server admins to handle, not players... except there are never any server admins on, at least not when I play. People are aware of this, and are also aware that there's nothing the other players can do about someone being a jackass.
My problem with people doesn't tend to be gameplay-related. If I'm not smart enough to figure out how to kill or avoid your trollmoth up there, well, that's my own damn fault. However, there NEEDS to be a way to squelch specific players in game chat as well as in voice.
Make THAT the vote system. Rather than instigating a kick from the server, make it instigate a mute on the player for the rest of the match; make it require 75% to pass so one team can't control it, perhaps also rig it so that if the enemy team starts the vote, it only squelches the players in broadcast, and if the friendly team starts it, it squelches the player in both broadcast and team.
That would solve, I suspect, 90% of the "griefing" problems. Either that or we could just NOT play on Huntress all the fscking time. I'm bored of their map rotation anyway.