Such punitive voting against ideas rather than for a misdeed or an offense does not comport with either the monastic ethos or the principles of civil discourse.
So, if you think people shouldn't downvote because they don't agree with the idea, and should only downvote on misdeeds or offenses, do you also agree people shouldn't upvote your post if they agree with your idea, and only upvote on real acts of goodness?
Why is it that if people complain about votes, it's always about downvotes -- noone seems to complain they got more upvotes than they should have gotten.