I don't know about going that far, but it would be nice to be able to see people's voting history. I'm not a big fan of anonymous hotlines in real life, and I'm not a fan of people downvoting anonymously because their precious egos got hurt. For that matter, upvoting crap posts just because people are lazy and want their daily points without spending any time thinking about it is a big problem here too. I've seen totally horrible code that doesn't even work get a positive rating, or one-line posts at the start of a thread get higher ratings than posts a little further down with a full, well-coded solution that probably took 20-30 minutes to work out.
People's votes should be visible, you should have to type in a short reason as to why you're making your vote, and if the site mods downvote a post, anyone who upvoted that post should lose a point. Site mod vote display would of course be delayed several days, as would the loss of points, so people can't just see which way the wind is blowing and switch votes. This would make some people think a lot more carefully before they downvote or upvote.