http://www.perlmonks.org?node_id=929425


in reply to What Tools Do You Use With WWW::Mechanize

I'll tell you a technique I probably *should* be using with Mech, which is to either locally cache content or introduce some kind of random delays between loading a page and clicking on a link in it because sometimes servers don't like bots accessing their sites. Also, I copy the UA string verbatim from my browser which works, rather than trying to figure out exactly what parts of it are what I need.

I like computer programming because it's like Legos for the mind.