Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl: the Markov chain saw
 
PerlMonks  

WWW::Mechanize emulate browser

by jonnyfolk (Vicar)
on Dec 07, 2008 at 11:44 UTC ( #728692=perlquestion: print w/ replies, xml ) Need Help??
jonnyfolk has asked for the wisdom of the Perl Monks concerning the following question:

I am doing some property searching and thought it would be a fun way of sharing thoughts on properties with my wife (who's on a different shift) by using Mechanize and creating annotations to each other's choices.

I've run into a problem with one particular site, however, who seem to take exception to the script! To demonstrate I have taken the script back to basics and am pointing to their home page. I wonder if a kind soul could take a look and see if there's a problem, or a way of resolving this? (Note: I can access via a browser, (safari, firefox) but not the script!

#!/usr/bin/perl use strict; use WWW::Mechanize; use CGI qw(:all); use CGI::Carp qw(fatalsToBrowser); my $add = 'http://www.coldwellbanker.com'; print "Content-type: text/html\n\n"; my $mech = WWW::Mechanize->new(); $mech->get($add); $mech->agent('Firefox/1.0 (Windows; U; Win98; en-US; Localization; r +v:1.4) Gecko/20030624 Netscape/7.1 (ax)'); my $result = $mech->content; print "<br>$result<br>";

Comment on WWW::Mechanize emulate browser
Download Code
Re: WWW::Mechanize emulate browser
by Anonymous Monk on Dec 07, 2008 at 11:54 UTC
    That works for me, so the problem is on your end.
      Thanks for checking it out. I've uploaded the script to a different server and it worked for me too. Strange that it only seems to be that site that was blanking out on the original server. Thanks once again...

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: perlquestion [id://728692]
Approved by Corion
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others browsing the Monastery: (9)
As of 2014-07-29 20:19 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My favorite superfluous repetitious redundant duplicative phrase is:









    Results (226 votes), past polls