Beefy Boxes and Bandwidth Generously Provided by pair Networks
Syntactic Confectionery Delight

Need to pull a javascript generated webpage

by miriamherald (Initiate)
on Feb 03, 2010 at 17:22 UTC ( #821224=perlquestion: print w/replies, xml ) Need Help??
miriamherald has asked for the wisdom of the Perl Monks concerning the following question:

I have a webpage that is generated almost entirely using javascript:
<div class="teamleaders"> <script LANGUAGE="JavaScript" SRC=""></script>
Pulling this page just reveals all the javascript code rather than the html generated by the page. All I want to do is 'get' the file using an LWP agent and print the html to a new static file - I do not want the javascript code, I want rather the html that it generates. How can I do this?

Replies are listed 'Best First'.
Re: Need to pull a javascript generated webpage
by Corion (Pope) on Feb 03, 2010 at 17:28 UTC
      Thanks Corion- how do you suggest I go about replicating it? I've used the Perl::Mechanize module before, but not Mechanize::Firefox. Can you give me a few more tips on how to implement this? I still feel lost.
Re: Need to pull a javascript generated webpage
by pileofrogs (Priest) on Feb 03, 2010 at 19:04 UTC

      Hm, are you sure that lynx supports Javascript (to render the page)?

      Maybe you are thinking of ELinks, which does have some limited JavaScript support?

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: perlquestion [id://821224]
Approved by marto
and all is quiet...

How do I use this? | Other CB clients
Other Users?
Others lurking in the Monastery: (4)
As of 2018-01-16 18:27 GMT
Find Nodes?
    Voting Booth?
    How did you see in the new year?

    Results (187 votes). Check out past polls.