Beefy Boxes and Bandwidth Generously Provided by pair Networks
Problems? Is your data what you think it is?
 
PerlMonks  

Web Crawler

by mkurtis (Scribe)
on Mar 08, 2004 at 20:24 UTC ( #334989=sourcecode: print w/replies, xml ) Need Help??

Help for this page

Select Code to Download


  1. or download this
    #!/usr/bin/perl -w
    
    ...
    close(FILE1);
    close(FILE2);
    }
    
  2. or download this
    
    #!/usr/bin/perl -w
    ...
    $http_ua->delay( 10 / 6000 );
    
    crawl(@ARGV);
    

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: sourcecode [id://334989]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others lurking in the Monastery: (8)
As of 2020-01-17 19:30 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Notices?