Beefy Boxes and Bandwidth Generously Provided by pair Networks
XP is just a number
 
PerlMonks  

Where is the Mozilla::Mechanize

by zli034 (Monk)
on Sep 01, 2007 at 23:44 UTC ( #636554=perlquestion: print w/ replies, xml ) Need Help??
zli034 has asked for the wisdom of the Perl Monks concerning the following question:

Scrap a web page, get round with javascript. Where is the Mozilla::Mechanize or win32::IE::mechanize, which compiled ready to install ppm repository? As far as I know, www::mechanize doesn't work with javascript. However, the ppm repositories I know, all don't provide win32::IE::Mechanize or Mozilla::Mechanize, which probably can do the work.

Comment on Where is the Mozilla::Mechanize
Re: Where is the Mozilla::Mechanize
by perrin (Chancellor) on Sep 02, 2007 at 03:32 UTC
    You don't need to execute JavaScript just to do web scraping. Read the page and do whatever the JavaScript would do. It is not possible for JavaScript to send a message to the server that you can't duplicate with WWW::Mechanize.
Re: Where is the Mozilla::Mechanize
by adrianh (Chancellor) on Sep 02, 2007 at 17:10 UTC

    Take a look at Selenium (perl drivers via WWW::Selenium and friends) that can be used to drive various browsers directly.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: perlquestion [id://636554]
Approved by leocharre
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others contemplating the Monastery: (9)
As of 2014-09-01 14:07 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My favorite cookbook is:










    Results (13 votes), past polls