gulden has asked for the wisdom of the Perl Monks concerning the following question:
I need to scrape webpages, where parts of the HTML page is obtained through the execution of Javascript function. For instance i need to scrape the inner table of this site http://tennis.7m.cn/default_en.aspx
There is a library to do this? How can I get a workaround around to do it, once I want to do this for several pages/sites?
WWW::Mechanize is not the solution: «That's because WWW::Mechanize doesn't operate on the JavaScript. It only understands the HTML parts of the page.»
$ wget also doesn't suppport it
Any workaround/solution?
«A contentious debate is always associated with a lack of valid arguments.»
|
---|
Replies are listed 'Best First'. | |
---|---|
Re: web scrapping with javascript support?
by runrig (Abbot) on Aug 03, 2010 at 16:42 UTC | |
Re: web scrapping with javascript support?
by mojotoad (Monsignor) on Aug 03, 2010 at 20:18 UTC | |
Re: web scrapping with javascript support?
by merlyn (Sage) on Aug 03, 2010 at 18:33 UTC | |
by gulden (Monk) on Aug 04, 2010 at 16:09 UTC | |
Re: web scrapping with javascript support?
by superfrink (Curate) on Aug 03, 2010 at 20:01 UTC |
Back to
Seekers of Perl Wisdom