If that feature in fact exists, it ought to be removed. I've never heard of it, but I cannot conceive of any rationale that would justify randomly taking away votes, and without an accompanying explanation no less.
Now there is a user named scapegoat, with no writeups and only 2 XP who hasn't been here in two years. Perhaps he/she can be the permanent target :^P
Apparently quite a few of us did not get votes this fine first day of 2003, myself included. So perhaps the scapegoat is taking revenge upon us. Affected users that I know of: pfaut, atcroft, adrianh, blaze, rozallin. /msg me and I'll add usernames to this list.
Update: apparently the vote allocating cron job crashed, so it's not a big hoary bug; the problem should be rectified the next time the job runs. So don't /msg me after all, as it won't do any good :^)