Beefy Boxes and Bandwidth Generously Provided by pair Networks
good chemistry is complicated,
and a little bit messy -LW

Re: WWW::Mechanize giving GET Errors

by kcott (Chancellor)
on Jun 13, 2013 at 16:19 UTC ( #1038793=note: print w/replies, xml ) Need Help??

in reply to WWW::Mechanize giving GET Errors

G'day bluesplay106,

"So I'm trying to create a web crawler and for some reason Mechanize is giving me some weird errors. So when I run my crawler it's fine, but then it just starts giving me GET errors for every link. I tried validating the link on my browser and using $mech->get and I received no error. Does Mechanize or the website I'm crawling have some sort of search limit? Thanks"

All the psychic monks are on a retreat this month. If you'd like an answer before their return, you'll need to provide some additional information:

  • What are the errors?
  • What code generates the errors?
  • Under what conditions does it run fine?
  • Under what conditions does it return errors?
  • What website are you crawling?

See: How do I post a question effectively?

-- Ken

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1038793]
and all is quiet...

How do I use this? | Other CB clients
Other Users?
Others making s'mores by the fire in the courtyard of the Monastery: (5)
As of 2018-01-21 09:36 GMT
Find Nodes?
    Voting Booth?
    How did you see in the new year?

    Results (227 votes). Check out past polls.