Beefy Boxes and Bandwidth Generously Provided by pair Networks
There's more than one way to do things
 
PerlMonks  

Re: WWW::Mechanize submission problem

by johnnywang (Priest)
on Feb 05, 2006 at 20:03 UTC ( #528090=note: print w/replies, xml ) Need Help??


in reply to WWW::Mechanize submission problem

I do lots of scraping/automation with LWP/WWW::Mechanize, I found the following two are very useful:
  • Ethereal, so you can see what actually gets sent, and compare that with what the browser is sending.
  • "perl -d", yes, perl debugger, stepping through the code is really useful.
I am able to solve most of my problems using these two (except those with heavy javascript.)

Replies are listed 'Best First'.
Re^2: WWW::Mechanize submission problem
by john_oshea (Priest) on Feb 05, 2006 at 21:42 UTC
      Since we're talking about Firefox extensions, I use the WebDeveloper extension alot, it not only can show you the headers, but also can show such things as layout outlines, which is really useful when combined with HTML::TableExtract for screen scraping. You can download it from http://chrispederick.com/work/webdeveloper/

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://528090]
help
Chatterbox?
[holli]: like dorothy?
[james28909]: see ya later holli
[james28909]: yeah like wizard of oz lol. its just a joke though
[james28909]: i cannot understand how someone cant see that a cloud of gas that evolves into a solar system or galaxies. it just makes sense to me. everythign that has happened, had to have happened for anything on this planet to be.
[james28909]: /gas/gas and debris/
[james28909]: another thing, i used to be atheist. life experiences, personal evidence. and my own perception is the reason why i believe the things i do.
[erix]: and now you are agnostic?
[james28909]: arunbear, your picking bits of history to fit your own narrative. right now, humans are smarter than in any of those times.
[james28909]: in order for there to be a mutation, there has to be a universe with laws setup that even allow a mutation.

How do I use this? | Other CB clients
Other Users?
Others wandering the Monastery: (13)
As of 2017-12-15 14:48 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    What programming language do you hate the most?




















    Results (433 votes). Check out past polls.

    Notices?