Re^3: Scraping AJAX?

[kelchris]

Thats because you need to get() the JSON data which contains the actual table you want to scrape. The content you are getting is only the page that contains the JS functions and there should also be the ajax link in there you can use to get the actual data.

Once you get that link, get() it then parse the data from there.

[Dave_COS]

Forgive me again if this is answered elsewhere --

Is there a way to do this on a headless system? firefox insists on a display....

System: Ubuntu server 10.04

[Corion]

Maybe you have an unstated problem with the following advice:

get() the JSON data which contains the actual table you want to scrape.

Please see Re^5: can't get WWW::Mechanize to sign in on JustAnswer and Re^5: can't get WWW::Mechanize to sign in on JustAnswer