Beefy Boxes and Bandwidth Generously Provided by pair Networks
No such thing as a small change
 
PerlMonks  

Re: LWP question

by eric256 (Parson)
on Jan 20, 2010 at 22:47 UTC ( #818580=note: print w/ replies, xml ) Need Help??


in reply to LWP question

I know in the past i've had issues with several of the search engines where they will block requests by IP if they see repeated requests by UserAgents that look like bots/spiders/etc. (Oh and please read that whole section below your post about formatting.


___________
Eric Hodges


Comment on Re: LWP question
Re^2: LWP question
by sri1230 (Novice) on Jan 21, 2010 at 14:45 UTC
    Thanks a bunch guys. It was a proxy issue, as i was using my work machine which was blocking it.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://818580]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chilling in the Monastery: (7)
As of 2014-07-12 00:47 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    When choosing user names for websites, I prefer to use:








    Results (238 votes), past polls