Beefy Boxes and Bandwidth Generously Provided by pair Networks
Just another Perl shrine
 
PerlMonks  

Re: check multiple URLS in the same time

by philiprbrenan (Monk)
on Sep 01, 2012 at 16:39 UTC ( #991170=note: print w/ replies, xml ) Need Help??


in reply to check multiple URLS in the same time

Threads work well (for this request) on Windows:

use feature ":5.14"; use warnings FATAL => qw(all); use strict; use threads; use LWP::Simple; my @u = qw(drudgereport.com rushlimbaugh.com/home/today.guest.html yah +oo.com appaapps.com cdsllc.com gdfgfasgdfgfs.jkl); sub u($) {get('http://www.'.$_[0])} # Web request my %t; $t{threads->create('u', $_)->tid}{url} = $_ for @u; # Start th +reads for(1..10) # Retrieve completed requests with time limits {$t{$_->tid}{data} = $_->join for threads->list(threads::joinable); last unless scalar threads->list(threads::running); sleep(1); } say $t{$_}{url}, "=", ($t{$_}{data} ? 1 : 0) for sort {$t{$a}{url} cmp + $t{$b}{url}} keys %t;

Produces

appaapps.com=1 cdsllc.com=1 drudgereport.com=1 gdfgfasgdfgfs.jkl=0 rushlimbaugh.com/home/today.guest.html=1 yahoo.com=1


Comment on Re: check multiple URLS in the same time
Select or Download Code

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://991170]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others about the Monastery: (8)
As of 2014-09-02 22:26 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My favorite cookbook is:










    Results (32 votes), past polls