I apologize to anyone who may take offense to the following, but I find it very barbaric.
Most people, I believe, downvote because they do not agree with someone's opinion. I cannot see how that is different than someone throwing a stone at another person just because they do not agree with them.
Maybe web communities are still primitive, or maybe there is a real flaw in current commenting/rating systems.
If there were some consequences to downvoting, i.e. we knew who downvoted whom, what do you think would be the result?