Beefy Boxes and Bandwidth Generously Provided by pair Networks
Think about Loose Coupling
 
PerlMonks  

Where is the Mozilla::Mechanize

by zli034 (Monk)
on Sep 01, 2007 at 23:44 UTC ( #636554=perlquestion: print w/ replies, xml ) Need Help??
zli034 has asked for the wisdom of the Perl Monks concerning the following question:

Scrap a web page, get round with javascript. Where is the Mozilla::Mechanize or win32::IE::mechanize, which compiled ready to install ppm repository? As far as I know, www::mechanize doesn't work with javascript. However, the ppm repositories I know, all don't provide win32::IE::Mechanize or Mozilla::Mechanize, which probably can do the work.

Comment on Where is the Mozilla::Mechanize
Replies are listed 'Best First'.
Re: Where is the Mozilla::Mechanize
by perrin (Chancellor) on Sep 02, 2007 at 03:32 UTC
    You don't need to execute JavaScript just to do web scraping. Read the page and do whatever the JavaScript would do. It is not possible for JavaScript to send a message to the server that you can't duplicate with WWW::Mechanize.
Re: Where is the Mozilla::Mechanize
by adrianh (Chancellor) on Sep 02, 2007 at 17:10 UTC

    Take a look at Selenium (perl drivers via WWW::Selenium and friends) that can be used to drive various browsers directly.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: perlquestion [id://636554]
Approved by leocharre
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others cooling their heels in the Monastery: (9)
As of 2015-07-31 01:54 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (274 votes), past polls