Beefy Boxes and Bandwidth Generously Provided by pair Networks
go ahead... be a heretic

Re: WWW::Mechanize submission problem

by johnnywang (Priest)
on Feb 05, 2006 at 20:03 UTC ( #528090=note: print w/ replies, xml ) Need Help??

in reply to WWW::Mechanize submission problem

I do lots of scraping/automation with LWP/WWW::Mechanize, I found the following two are very useful:

  • Ethereal, so you can see what actually gets sent, and compare that with what the browser is sending.
  • "perl -d", yes, perl debugger, stepping through the code is really useful.
I am able to solve most of my problems using these two (except those with heavy javascript.)

Comment on Re: WWW::Mechanize submission problem
Replies are listed 'Best First'.
Re^2: WWW::Mechanize submission problem
by john_oshea (Priest) on Feb 05, 2006 at 21:42 UTC
      Since we're talking about Firefox extensions, I use the WebDeveloper extension alot, it not only can show you the headers, but also can show such things as layout outlines, which is really useful when combined with HTML::TableExtract for screen scraping. You can download it from

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://528090]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others drinking their drinks and smoking their pipes about the Monastery: (9)
As of 2015-11-24 23:10 GMT
Find Nodes?
    Voting Booth?

    What would be the most significant thing to happen if a rope (or wire) tied the Earth and the Moon together?

    Results (665 votes), past polls