Beefy Boxes and Bandwidth Generously Provided by pair Networks
Syntactic Confectionery Delight
 
PerlMonks  

Re: Using LWP::UserAgent to Get Web Pages

by Popcorn Dave (Abbot)
on Jun 14, 2007 at 15:54 UTC ( #621275=note: print w/replies, xml ) Need Help??


in reply to Using LWP::UserAgent to Get Web Pages

It works just fine on Windows too.

How many times did you try this? Did it ever return anything for you? The reason I ask is that I seem to recall that Google doesn't really like people writing their own page scrapers so they may have blocked your IP temporarily. They have their own tools they want you to use.

What you might consider trying is changing the URL that you're trying to access to see if Google is blocking your IP.

The other question I have is why you have the here doc in that snippet of code, because you're never using it. Or was it part of the larger program?


Revolution. Today, 3 O'Clock. Meet behind the monkey bars.

I would love to change the world, but they won't give me the source code

  • Comment on Re: Using LWP::UserAgent to Get Web Pages

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://621275]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chanting in the Monastery: (4)
As of 2019-05-25 13:22 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Do you enjoy 3D movies?



    Results (152 votes). Check out past polls.

    Notices?
    • (Sep 10, 2018 at 22:53 UTC) Welcome new users!