Beefy Boxes and Bandwidth Generously Provided by pair Networks
P is for Practical

Where is the Mozilla::Mechanize

by zli034 (Monk)
on Sep 01, 2007 at 23:44 UTC ( #636554=perlquestion: print w/replies, xml ) Need Help??
zli034 has asked for the wisdom of the Perl Monks concerning the following question:

Scrap a web page, get round with javascript. Where is the Mozilla::Mechanize or win32::IE::mechanize, which compiled ready to install ppm repository? As far as I know, www::mechanize doesn't work with javascript. However, the ppm repositories I know, all don't provide win32::IE::Mechanize or Mozilla::Mechanize, which probably can do the work.

Replies are listed 'Best First'.
Re: Where is the Mozilla::Mechanize
by perrin (Chancellor) on Sep 02, 2007 at 03:32 UTC
    You don't need to execute JavaScript just to do web scraping. Read the page and do whatever the JavaScript would do. It is not possible for JavaScript to send a message to the server that you can't duplicate with WWW::Mechanize.
Re: Where is the Mozilla::Mechanize
by adrianh (Chancellor) on Sep 02, 2007 at 17:10 UTC

    Take a look at Selenium (perl drivers via WWW::Selenium and friends) that can be used to drive various browsers directly.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: perlquestion [id://636554]
Approved by leocharre
and all is quiet...

How do I use this? | Other CB clients
Other Users?
Others scrutinizing the Monastery: (5)
As of 2018-03-18 21:59 GMT
Find Nodes?
    Voting Booth?
    When I think of a mole I think of:

    Results (231 votes). Check out past polls.