Why not do it the other way around? As chromatic
put it, when you have only 5 votes you treat each of them as if they were gems. Then why not keep them that way? People should be excited to be able to vote in the 1st place. Not only
because it gives you XPs, but because its a priviledge. I've noticed that since I made monk, I've increased my XPs A LOT just by the mere voting quantity factor, and sincerely, I think each one of my votes actually is worth less now.
To be able to do a "trusty vote" does it really matter how much XPs you have? Bottom line, I say keep the voting XPs but don't increase the number of votes as you "grow".
# Trust no1!