Beefy Boxes and Bandwidth Generously Provided by pair Networks
Your skill will accomplish
what the force of many cannot

Re^2: Parsing AJAX-based website

by Anonymous Monk
on Feb 25, 2013 at 12:48 UTC ( #1020511=note: print w/ replies, xml ) Need Help??

in reply to Re: Parsing AJAX-based website
in thread Parsing AJAX-based website

I am trying to parse a website and the site loads a basic page that I can get with mechanize-get($url). But the Tags and Page data that I want to get is not found content. I think its an ajax call. I do not know how to get my script to get the tags. When I look at google chrome(element inspect), ie(F12 key), mozilla firebug all of them show the tags that I am looking for. But how do I get to the tags. Help will be appreciated.

Comment on Re^2: Parsing AJAX-based website
Replies are listed 'Best First'.
Re^3: Parsing AJAX-based website
by marto (Bishop) on Feb 25, 2013 at 12:52 UTC
Re^3: Parsing AJAX-based website
by tmharish (Friar) on Feb 25, 2013 at 12:52 UTC

    Look at the Net tab in firebug or 'Network' tab on chrome and find all the requests going out.

    Identify the request you are interested in - find out how that part is constructed ( based on the AJAX code that is present ) and make that call.

    As a note some of the modules mentioned above do this for you.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1020511]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others drinking their drinks and smoking their pipes about the Monastery: (3)
As of 2015-10-04 13:08 GMT
Find Nodes?
    Voting Booth?

    Does Humor Belong in Programming?

    Results (102 votes), past polls