Beefy Boxes and Bandwidth Generously Provided by pair Networks
Welcome to the Monastery
 
PerlMonks  

Re: WWW::Mechanize giving GET Errors

by kcott (Abbot)
on Jun 13, 2013 at 16:19 UTC ( #1038793=note: print w/ replies, xml ) Need Help??


in reply to WWW::Mechanize giving GET Errors

G'day bluesplay106,

"So I'm trying to create a web crawler and for some reason Mechanize is giving me some weird errors. So when I run my crawler it's fine, but then it just starts giving me GET errors for every link. I tried validating the link on my browser and using $mech->get and I received no error. Does Mechanize or the website I'm crawling have some sort of search limit? Thanks"

All the psychic monks are on a retreat this month. If you'd like an answer before their return, you'll need to provide some additional information:

  • What are the errors?
  • What code generates the errors?
  • Under what conditions does it run fine?
  • Under what conditions does it return errors?
  • What website are you crawling?

See: How do I post a question effectively?

-- Ken


Comment on Re: WWW::Mechanize giving GET Errors

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1038793]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others avoiding work at the Monastery: (9)
As of 2014-12-22 22:26 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    Is guessing a good strategy for surviving in the IT business?





    Results (132 votes), past polls