Beefy Boxes and Bandwidth Generously Provided by pair Networks
Do you know where your variables are?
 
PerlMonks  

Re^4: stuck with WWW::Mechanize drop down list

by spazm (Monk)
on Jun 02, 2012 at 06:09 UTC ( #973941=note: print w/ replies, xml ) Need Help??


in reply to Re^3: stuck with WWW::Mechanize drop down list
in thread stuck with WWW::Mechanize drop down list

I was just about to suggest mech-dump, good that you are already using it!

Mechanize will only return form elements that are within <form></form> elements.

The "All" dropdown is not within a set of form tags, it directly triggers javascript to reload the page. In cases like this you just have to figure out what the script is doing and duplicate. Possibly just by inspecting the request URL submitted by the browser.

This is an area where scraping pages becomes tedious and tricky.


Comment on Re^4: stuck with WWW::Mechanize drop down list
Re^5: stuck with WWW::Mechanize drop down list
by abualiga (Scribe) on Jun 02, 2012 at 13:22 UTC

    Thanks again!

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://973941]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others scrutinizing the Monastery: (9)
As of 2014-12-28 19:29 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    Is guessing a good strategy for surviving in the IT business?





    Results (182 votes), past polls