Beefy Boxes and Bandwidth Generously Provided by pair Networks
Pathologically Eclectic Rubbish Lister

Re: WWW::Mechanize giving GET Errors

by kcott (Canon)
on Jun 13, 2013 at 16:19 UTC ( #1038793=note: print w/ replies, xml ) Need Help??

in reply to WWW::Mechanize giving GET Errors

G'day bluesplay106,

"So I'm trying to create a web crawler and for some reason Mechanize is giving me some weird errors. So when I run my crawler it's fine, but then it just starts giving me GET errors for every link. I tried validating the link on my browser and using $mech->get and I received no error. Does Mechanize or the website I'm crawling have some sort of search limit? Thanks"

All the psychic monks are on a retreat this month. If you'd like an answer before their return, you'll need to provide some additional information:

  • What are the errors?
  • What code generates the errors?
  • Under what conditions does it run fine?
  • Under what conditions does it return errors?
  • What website are you crawling?

See: How do I post a question effectively?

-- Ken

Comment on Re: WWW::Mechanize giving GET Errors

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1038793]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others meditating upon the Monastery: (10)
As of 2015-11-26 06:32 GMT
Find Nodes?
    Voting Booth?

    What would be the most significant thing to happen if a rope (or wire) tied the Earth and the Moon together?

    Results (696 votes), past polls