Beefy Boxes and Bandwidth Generously Provided by pair Networks
Problems? Is your data what you think it is?

Re^2: Parsing AJAX-based website

by Anonymous Monk
on Feb 25, 2013 at 12:48 UTC ( #1020511=note: print w/replies, xml ) Need Help??

in reply to Re: Parsing AJAX-based website
in thread Parsing AJAX-based website

I am trying to parse a website and the site loads a basic page that I can get with mechanize-get($url). But the Tags and Page data that I want to get is not found content. I think its an ajax call. I do not know how to get my script to get the tags. When I look at google chrome(element inspect), ie(F12 key), mozilla firebug all of them show the tags that I am looking for. But how do I get to the tags. Help will be appreciated.

Replies are listed 'Best First'.
Re^3: Parsing AJAX-based website
by marto (Bishop) on Feb 25, 2013 at 12:52 UTC
Re^3: Parsing AJAX-based website
by tmharish (Friar) on Feb 25, 2013 at 12:52 UTC

    Look at the Net tab in firebug or 'Network' tab on chrome and find all the requests going out.

    Identify the request you are interested in - find out how that part is constructed ( based on the AJAX code that is present ) and make that call.

    As a note some of the modules mentioned above do this for you.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1020511]
[talexb]: Great quote from Re: (OT) Motivating the Unmotivated Programmer: "As Weinberg suggests, when a programmer becomes irreplaceable, it's time to replace him."
[jedikaiti]: SuicideJunkie++ #Apgrade is the highest point it will reach. They're informing you that it will all be downhill from here until the software hits a PEgrade, or impacts the terrain depending on the details of the orbit.

How do I use this? | Other CB clients
Other Users?
Others perusing the Monastery: (8)
As of 2017-07-25 18:45 GMT
Find Nodes?
    Voting Booth?
    I came, I saw, I ...

    Results (377 votes). Check out past polls.