http://www.perlmonks.org?node_id=1020511


in reply to Re: Parsing AJAX-based website
in thread Parsing AJAX-based website

I am trying to parse a website and the site loads a basic page that I can get with mechanize-get($url). But the Tags and Page data that I want to get is not found content. I think its an ajax call. I do not know how to get my script to get the tags. When I look at google chrome(element inspect), ie(F12 key), mozilla firebug all of them show the tags that I am looking for. But how do I get to the tags. Help will be appreciated.

Replies are listed 'Best First'.
Re^3: Parsing AJAX-based website
by marto (Cardinal) on Feb 25, 2013 at 12:52 UTC
Re^3: Parsing AJAX-based website
by tmharish (Friar) on Feb 25, 2013 at 12:52 UTC

    Look at the Net tab in firebug or 'Network' tab on chrome and find all the requests going out.

    Identify the request you are interested in - find out how that part is constructed ( based on the AJAX code that is present ) and make that call.

    As a note some of the modules mentioned above do this for you.