Beefy Boxes and Bandwidth Generously Provided by pair Networks
Clear questions and runnable code
get the best and fastest answer
 
PerlMonks  

LWP Analysis

by spatterson (Monk)
on Jan 05, 2007 at 14:29 UTC ( #593114=snippet: print w/ replies, xml ) Need Help??
Description: I sometimes need to check exactly what data a webserver has returned for a URL without letting a browser interfere & reinterpret any of it, so this perl script follows me around.

It will print out the HTTP header (including cookies) and the full body for a URL given on the command line.

#!/usr/bin/perl -w

use LWP::UserAgent;
my $ua = LWP::UserAgent->new(
                             keep_alive => 1,
                             timeout => 30,
                             debug => 1
                             );
my $body = $ua->get($ARGV[0]);
print $body->as_string;
Replies are listed 'Best First'.
Re: LWP Analysis
by merlyn (Sage) on Jan 05, 2007 at 15:54 UTC
      or
      GET http://www.example.com/

      ( or not. see the reply. )

        Modern LWP defaults to not install GET any more, since it's merely a subfunction of lwp-request, and might collide with other tools too easily.

        Also, GET as you've invoked it doesn't show the headers.

Re: LWP Analysis
by ww (Bishop) on Jan 05, 2007 at 16:04 UTC
    Minor note

    Under winXP & AS 5.8.8 (819), and PRIOR to commenting out "debug => 1"
    OP's code spits out a warning

    Unrecognized LWP::UserAgent options: debug at (line ref to "debug => 1")

    before proceeding to produce the expected output.

    Haven't investigated reason yet, but a very handy snippet, indeed! Thank you, spatterson
Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: snippet [id://593114]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others pondering the Monastery: (7)
As of 2016-08-27 17:01 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    The best thing I ever won in a lottery was:















    Results (381 votes). Check out past polls.