Beefy Boxes and Bandwidth Generously Provided by pair Networks
Just another Perl shrine

Re: WWW::Mechanize giving GET Errors

by kcott (Canon)
on Jun 13, 2013 at 16:19 UTC ( #1038793=note: print w/replies, xml ) Need Help??

in reply to WWW::Mechanize giving GET Errors

G'day bluesplay106,

"So I'm trying to create a web crawler and for some reason Mechanize is giving me some weird errors. So when I run my crawler it's fine, but then it just starts giving me GET errors for every link. I tried validating the link on my browser and using $mech->get and I received no error. Does Mechanize or the website I'm crawling have some sort of search limit? Thanks"

All the psychic monks are on a retreat this month. If you'd like an answer before their return, you'll need to provide some additional information:

  • What are the errors?
  • What code generates the errors?
  • Under what conditions does it run fine?
  • Under what conditions does it return errors?
  • What website are you crawling?

See: How do I post a question effectively?

-- Ken

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1038793]
[ambrus]: GotToBTru: wait, you tell only the atom totals of what you want? Is that like ordering food in a restaurant by telling only the nutrient amounts you need, or
[ambrus]: like when a medieval scientist supposedly proves his priority inventing something by having previously published an anagram of a thousand letters long summary of the invention?
[choroba]: Progress! Nowadays, you can write a Perl script to generate such an anagram!
[GotToBTru]: i like to order my chemicals a-la-carte ambrus ;)

How do I use this? | Other CB clients
Other Users?
Others about the Monastery: (8)
As of 2016-12-06 13:04 GMT
Find Nodes?
    Voting Booth?
    On a regular basis, I'm most likely to spy upon:

    Results (104 votes). Check out past polls.