Beefy Boxes and Bandwidth Generously Provided by pair Networks
laziness, impatience, and hubris
 
PerlMonks  

Re^3: Mech and Javascript

by Popcorn Dave (Abbot)
on Jun 14, 2008 at 18:34 UTC ( #692100=note: print w/ replies, xml ) Need Help??


in reply to Re^2: Mech and Javascript
in thread Mech and Javascript

You're probably going to get much better responses if you show the Perl code you tried, not just the HTML you're trying to work with.


Revolution. Today, 3 O'Clock. Meet behind the monkey bars.

I would love to change the world, but they won't give me the source code


Comment on Re^3: Mech and Javascript
Re^4: Mech and Javascript
by jcdento (Novice) on Jun 16, 2008 at 12:59 UTC
    Sorry, the javascript comes later (after I click that link, I get a javascript table). I cannot find the link, even by viewing the source code then by calling it by name. Here is the code I am using:
    my $agent = WWW::Mechanize->new(autocheck=>1, agent=> 'Mozilla/5.0 (Wi +ndows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/ +2.0.0.14', requests_redirectable => [ 'GET', 'HEAD', 'POST' ]); my $response = $agent->get($url2); $response = $agent->get($url); my $form = HTML::Form->parse($response->{_content}, $response->base()) +; $form->param("username", "usrname"); $form->param("password", "pass"); $response = $agent->request($form->click); $response->{_content} =~ /(https:\/\/\S+)"/ or die; $url = $1; $response = $agent->get($url); print $response->decoded_content; $url = 'https://linkfromsite.com'; #Note: This link is in the form of + /abc/words/main/ and although it goes to site.com/abc/words/main whe +n mousing over the link in firefox it shows only the /abc/etc. part $response = $agent->get($url); #code fails at this point, response is a website-generated error #$response = $agent->click("URL"); $response = $agent->reload;
    Please note I am using made up site names since the actual name of the site cannot be disclosed.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://692100]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chilling in the Monastery: (6)
As of 2014-12-29 08:05 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    Is guessing a good strategy for surviving in the IT business?





    Results (185 votes), past polls