Beefy Boxes and Bandwidth Generously Provided by pair Networks
Think about Loose Coupling

Re^2: Parsing AJAX-based website

by Anonymous Monk
on Feb 25, 2013 at 12:48 UTC ( #1020511=note: print w/ replies, xml ) Need Help??

in reply to Re: Parsing AJAX-based website
in thread Parsing AJAX-based website

I am trying to parse a website and the site loads a basic page that I can get with mechanize-get($url). But the Tags and Page data that I want to get is not found content. I think its an ajax call. I do not know how to get my script to get the tags. When I look at google chrome(element inspect), ie(F12 key), mozilla firebug all of them show the tags that I am looking for. But how do I get to the tags. Help will be appreciated.

Comment on Re^2: Parsing AJAX-based website
Re^3: Parsing AJAX-based website
by marto (Chancellor) on Feb 25, 2013 at 12:52 UTC
Re^3: Parsing AJAX-based website
by tmharish (Friar) on Feb 25, 2013 at 12:52 UTC

    Look at the Net tab in firebug or 'Network' tab on chrome and find all the requests going out.

    Identify the request you are interested in - find out how that part is constructed ( based on the AJAX code that is present ) and make that call.

    As a note some of the modules mentioned above do this for you.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1020511]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others scrutinizing the Monastery: (6)
As of 2014-09-17 02:50 GMT
Find Nodes?
    Voting Booth?

    How do you remember the number of days in each month?

    Results (56 votes), past polls