Beefy Boxes and Bandwidth Generously Provided by pair Networks
P is for Practical

Need to pull a javascript generated webpage

by miriamherald (Initiate)
on Feb 03, 2010 at 17:22 UTC ( #821224=perlquestion: print w/ replies, xml ) Need Help??
miriamherald has asked for the wisdom of the Perl Monks concerning the following question:

I have a webpage that is generated almost entirely using javascript:
<div class="teamleaders"> <script LANGUAGE="JavaScript" SRC=""></script>
Pulling this page just reveals all the javascript code rather than the html generated by the page. All I want to do is 'get' the file using an LWP agent and print the html to a new static file - I do not want the javascript code, I want rather the html that it generates. How can I do this?

Comment on Need to pull a javascript generated webpage
Download Code
Re: Need to pull a javascript generated webpage
by Corion (Pope) on Feb 03, 2010 at 17:28 UTC
      Thanks Corion- how do you suggest I go about replicating it? I've used the Perl::Mechanize module before, but not Mechanize::Firefox. Can you give me a few more tips on how to implement this? I still feel lost.
Re: Need to pull a javascript generated webpage
by pileofrogs (Priest) on Feb 03, 2010 at 19:04 UTC

      Hm, are you sure that lynx supports Javascript (to render the page)?

      Maybe you are thinking of ELinks, which does have some limited JavaScript support?

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: perlquestion [id://821224]
Approved by marto
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others avoiding work at the Monastery: (4)
As of 2015-02-28 07:33 GMT
Find Nodes?
    Voting Booth?

    On my keyboard, Caps lock is:

    Results (459 votes), past polls