Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl Monk, Perl Meditation
 
PerlMonks  

Re: Cookie protected web page and file downloading

by tlm (Prior)
on Jun 02, 2005 at 03:13 UTC ( #462733=note: print w/ replies, xml ) Need Help??


in reply to Cookie protected web page and file downloading

I find that WWW::Mechanize is pretty good with cookie-ness. Have you tried it?

the lowliest monk


Comment on Re: Cookie protected web page and file downloading
Re^2: Cookie protected web page and file downloading
by reTard (Sexton) on Jun 02, 2005 at 03:42 UTC
    I've had a look at Mech but I can't see where to specify the HTTP proxy details?
    thanks
        So far I have:
        #!/usr/bin/perl use Data::Dumper; use LWP::UserAgent; use WWW::Mechanize; my $mech = WWW::Mechanize->new(cookie_jar => {}, agent => "WWW-Mechani +ze/0.01"); $url = 'http://www.ibm.com/servers/eserver/support/pseries/aixfixes.ht +ml'; my $ua = new LWP::UserAgent; $ua->proxy('http','192.168.1.248'); $mech->get( $url ); $mech->follow_link( text_regex => qr/More fix services/); $mech->follow_link( text_regex => qr/AIX 5.3/); $mech->follow_link( text_regex => qr/Data file for AIX 5.3/); print Dumper $mech;

        But this fails as it is not going through the proxy
        Thanks

        UPDATED the print dump shows

        'status' => 500, 'content' => '500 Can\'t connect to www.ibm.com:80 (B +ad hostname \'www.ibm.com\')

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://462733]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chanting in the Monastery: (6)
As of 2014-07-30 21:46 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My favorite superfluous repetitious redundant duplicative phrase is:









    Results (241 votes), past polls