http://www.perlmonks.org?node_id=818580


in reply to LWP question

I know in the past i've had issues with several of the search engines where they will block requests by IP if they see repeated requests by UserAgents that look like bots/spiders/etc. (Oh and please read that whole section below your post about formatting.


___________
Eric Hodges