Beefy Boxes and Bandwidth Generously Provided by pair Networks
Do you know where your variables are?
 
PerlMonks  

Re^3: Scraping AJAX?

by kelchris (Novice)
on Jan 26, 2012 at 17:40 UTC ( #950180=note: print w/ replies, xml ) Need Help??


in reply to Re^2: Scraping AJAX?
in thread Scraping AJAX?

Thats because you need to get() the JSON data which contains the actual table you want to scrape. The content you are getting is only the page that contains the JS functions and there should also be the ajax link in there you can use to get the actual data.

Once you get that link, get() it then parse the data from there.


Comment on Re^3: Scraping AJAX?
Re^4: Scraping AJAX?
by Dave_COS (Initiate) on Jan 26, 2012 at 19:03 UTC

    Forgive me again if this is answered elsewhere --

    Is there a way to do this on a headless system? firefox insists on a display....

    System: Ubuntu server 10.04

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://950180]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chilling in the Monastery: (7)
As of 2014-09-18 23:16 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    How do you remember the number of days in each month?











    Results (126 votes), past polls