http://www.perlmonks.org?node_id=860573

Anonymous Monk has asked for the wisdom of the Perl Monks concerning the following question:

I would like to be able to have the option to retry when I am running the code below. Is there an option in HTTP::Request::Common to do that? Also, is there a way to adjust the response time of the module so that it will wait for example, 5 seconds, before giving up? 
#!/usr/bin/perl

use warnings;
use strict;
use HTTP::Request::Common;
use LWP::UserAgent;

my $ua      = LWP::UserAgent->new( cookie_jar => '' );
my $request = HTTP::Request->new( 'GET', 'http://www.google.com' );
my $result  = $ua->request( $request );

print $result->status_line;

[download]

Replies are listed 'Best First'.
Re: HTTP::Request::Common Retry Option
by Your Mother (Archbishop) on Sep 17, 2010 at 23:16 UTC

    I'm not sure your question makes any sense. What exactly is the problem you are having? What is the proof/output it is a problem? The agent will wait for the server to respond for $ua->timeout($seconds) and I think the default is three minutes.

    It's against Google's ToS to do automated hits against it without a developer key/agreement and they will block agents that seem to be violating that.

[reply]
[d/l]
Re: HTTP::Request::Common Retry Option
by Khen1950fx (Canon) on Sep 18, 2010 at 00:42 UTC
    You can control the number of retries by using LWP::UserAgent::Determined. I set the timing string at 5 seconds, 10, and 20. I also added the codes that I wanted it to retry. 
    #!/usr/bin/perl

use strict;
use warnings;
use LWP::UserAgent::Determined;

my $url = 'http://www.google.com';

my $browser  = LWP::UserAgent::Determined->new( 
               cookie_jar => '' );
my $timing_string = $browser->timing("5,10,20");
my $http_codes_hr = $browser->codes_to_determinate();
$http_codes_hr->{408} = 1;
$http_codes_hr->{500} = 1;
$http_codes_hr->{567} = 1;
$browser->before_determined_callback( sub {
    print "Trying ", $_[4][0]->uri, " at ",
    scalar(localtime), "...\n";  
});     
$browser->after_determined_callback( sub {
    print "Just tried ", $_[4][0]->uri, " at ",
    scalar(localtime), ".\n";
});   

my $response = $browser->get( $url );
print "That gave: ",$response->status_line, "\n";

    [download]
[reply]
[d/l]
      I was just about to ask a question along these lines. Good thing somebody beat me to it.
[reply]

Back to Seekers of Perl Wisdom