Everyone should change their passwords. Just because your password wasn't published (I was very tempted to post the link), doesn't mean that someone doesn't have it. Fortunately, a couple of years ago I started getting more concerned about security and I considered Perlmonks a "low-risk" site (in terms of whether or not I care about a compromise), so I deliberately switched this password to an unique easy-to-remember one (pineappl, if you're curious). It's now changed to something far stronger, but it's another throwaway password. I assume that things like this will recur. It's safer that way.