The other part of that is to be a tester for the CPAN.
Check out http://testers.cpan.org
and sign up to be a CPAN
tester. You'll get an email each time a module is uploaded
to the CPAN. Try to install a module, and send the results
to the CPAN with a handy-dandy little script. It adds a
few seconds after each time you install a module, and it
helps the authors know what works and doesn't.
I've been doing it for about a year now. It's certainly
not as useful as Chromatic going and writing up bunches of
tests for key modules, but then again, if people don't run
those tests, what good are they?
Throw down the gun and tiara and come out of the float!