Beefy Boxes and Bandwidth Generously Provided by pair Networks
Welcome to the Monastery
 
PerlMonks  

Need to pull a javascript generated webpage

by miriamherald (Initiate)
on Feb 03, 2010 at 17:22 UTC ( #821224=perlquestion: print w/ replies, xml ) Need Help??
miriamherald has asked for the wisdom of the Perl Monks concerning the following question:

I have a webpage that is generated almost entirely using javascript:
<div class="teamleaders"> <script LANGUAGE="JavaScript" SRC="http://www.mywebpage.com"></script>
Pulling this page just reveals all the javascript code rather than the html generated by the page. All I want to do is 'get' the file using an LWP agent and print the html to a new static file - I do not want the javascript code, I want rather the html that it generates. How can I do this?

Comment on Need to pull a javascript generated webpage
Download Code
Replies are listed 'Best First'.
Re: Need to pull a javascript generated webpage
by Corion (Pope) on Feb 03, 2010 at 17:28 UTC
      Thanks Corion- how do you suggest I go about replicating it? I've used the Perl::Mechanize module before, but not Mechanize::Firefox. Can you give me a few more tips on how to implement this? I still feel lost.
Re: Need to pull a javascript generated webpage
by pileofrogs (Priest) on Feb 03, 2010 at 19:04 UTC

      Hm, are you sure that lynx supports Javascript (to render the page)?

      Maybe you are thinking of ELinks, which does have some limited JavaScript support?

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: perlquestion [id://821224]
Approved by marto
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chanting in the Monastery: (10)
As of 2015-07-29 09:54 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (263 votes), past polls