Beefy Boxes and Bandwidth Generously Provided by pair Networks
Pathologically Eclectic Rubbish Lister
 
PerlMonks  

Re: Trying to fetch Google results via TreeBuilder: 403 Forbidden

by Anonymous Monk
on Oct 14, 2015 at 09:08 UTC ( [id://1144833]=note: print w/replies, xml ) Need Help??


in reply to Trying to fetch Google results via TreeBuilder: 403 Forbidden

Why?

Because you're not asking in the way that google likes to be asked (the headers, the request, its not what google wants)

And how can I get the actual result(s) instead?

Consult google documentation

If it works from firefox, duplicate the firefox headers, yeah you may have to use WWW::Mechanize for the actual fetching instead of new_from_url

  • Comment on Re: Trying to fetch Google results via TreeBuilder: 403 Forbidden

Replies are listed 'Best First'.
Re^2: Trying to fetch Google results via TreeBuilder: 403 Forbidden
by jekyll (Acolyte) on Oct 14, 2015 at 09:40 UTC

    \o,

    Google's documentation suggests me to build my own Custom Search. That's annoying.

    WWW::Mechanize works indeed, thanks. :-)

    Regards and all that,
    jkl

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://1144833]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others goofing around in the Monastery: (5)
As of 2024-04-18 20:22 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found