pg has said many times in the past that it's OK to downvote for disagreement -- even if a comment is civil, coherent, on-topic, etc. (I usually prefer to voice disagreement in such a case, but don't always have the time/energy.)

It's usually self-correcting. A lot more people can upvote than downvote, and most people don't like seeing good comments in the gray.