Beefy Boxes and Bandwidth Generously Provided by pair Networks
XP is just a number
 
PerlMonks  

Cookies issue with www::Mechanize

by Matt™ (Acolyte)
on Oct 17, 2012 at 10:32 UTC ( #999515=perlquestion: print w/ replies, xml ) Need Help??
Matt™ has asked for the wisdom of the Perl Monks concerning the following question:

Hi Monks, Need your Help!

I am using Mechanize to automate this URL https://sjobs.brassring.com/TGWebHost/searchresults.aspx?partnerid=25510&siteid=5136. but I am not getting the full contents( jobs available there)of that page while saving. I think some cookie issue or something is there, but i cant find(figure) it out. Pls suggest Monks. Looking for your help! Thanks in advance Monks.

Matt™

Pls find the code below,

use strict; use WWW::Mechanize; my $search_url = "https://sjobs.brassring.com/TGWebHost/searchresults. +aspx?partnerid=25510&siteid=5136"; my $mech = WWW::Mechanize->new( ); print "\nChecking: $search_url ...\n"; eval{ $mech->agent_alias('Mac Safari'); $mech->get($search_url); }; if ($@) { print "Error connecting to URL $search_url.\n($@)\n"; exit(1); } my $filename = 'OUTPUT.html'; $mech->save_content( $filename ); die;

Comment on Cookies issue with www::Mechanize
Select or Download Code
Re: Cookies issue with www::Mechanize
by zentara (Archbishop) on Oct 17, 2012 at 11:27 UTC

      Thanks Zentata, will check whether I can make it out... :)

Re: Cookies issue with www::Mechanize
by moritz (Cardinal) on Oct 17, 2012 at 11:28 UTC

    The URL seems to work fine without cookies. The data is just stored in a bit awkward way (as HTML-escaped JSON in an attribute of a <param> tag). Look at the source of the downloaded HTML file and see for yourself.

      Thanks Moritz, hope it will help me.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: perlquestion [id://999515]
Approved by Corion
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chilling in the Monastery: (7)
As of 2015-07-05 07:05 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (60 votes), past polls