Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl: the Markov chain saw
 
PerlMonks  

Re^4: Mech and Javascript

by jcdento (Novice)
on Jun 16, 2008 at 12:59 UTC ( #692248=note: print w/replies, xml ) Need Help??


in reply to Re^3: Mech and Javascript
in thread Mech and Javascript

Sorry, the javascript comes later (after I click that link, I get a javascript table). I cannot find the link, even by viewing the source code then by calling it by name. Here is the code I am using:
my $agent = WWW::Mechanize->new(autocheck=>1, agent=> 'Mozilla/5.0 (Wi +ndows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/ +2.0.0.14', requests_redirectable => [ 'GET', 'HEAD', 'POST' ]); my $response = $agent->get($url2); $response = $agent->get($url); my $form = HTML::Form->parse($response->{_content}, $response->base()) +; $form->param("username", "usrname"); $form->param("password", "pass"); $response = $agent->request($form->click); $response->{_content} =~ /(https:\/\/\S+)"/ or die; $url = $1; $response = $agent->get($url); print $response->decoded_content; $url = 'https://linkfromsite.com'; #Note: This link is in the form of + /abc/words/main/ and although it goes to site.com/abc/words/main whe +n mousing over the link in firefox it shows only the /abc/etc. part $response = $agent->get($url); #code fails at this point, response is a website-generated error #$response = $agent->click("URL"); $response = $agent->reload;
Please note I am using made up site names since the actual name of the site cannot be disclosed.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://692248]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others making s'mores by the fire in the courtyard of the Monastery: (4)
As of 2019-11-22 23:59 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Strict and warnings: which comes first?



    Results (113 votes). Check out past polls.

    Notices?