Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl-Sensitive Sunglasses
 
PerlMonks  

Checking URL links

by oaklander (Acolyte)
on Dec 28, 2001 at 17:04 UTC ( [id://134867]=perlquestion: print w/replies, xml ) Need Help??

oaklander has asked for the wisdom of the Perl Monks concerning the following question:

Is there any script that is available to check all web links in a directory. I have many html files in one directory and need to check if all the URL links are valid. The links consist of absolute and relative paths.

Replies are listed 'Best First'.
Re: Checking URL links
by rob_au (Abbot) on Dec 28, 2001 at 17:08 UTC
    There are countless such scripts available from sites such as http://www.freshmeat.net (including this one, this one and this one).

    On this site, I simply typed Link Checker into the search box and sure enough, an excellent example from tachyon was found here - In addition to checking href links, this script also checks img links and mailto links (for RFC822 compliance).

     

    perl -e 's&&rob@cowsnet.com.au&&&split/[@.]/&&s&.com.&_&&&print'

Re: Checking URL links
by newbie00 (Beadle) on Dec 28, 2001 at 23:51 UTC
    Here is another source for checking links. It is located at WebTester and it is easy to install and use. It does require either Telnet or SSH.

    Hope this helps.
    --newbie00

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: perlquestion [id://134867]
Approved by root
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others imbibing at the Monastery: (1)
As of 2025-04-18 04:56 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found

    Notices?
    erzuuliAnonymous Monks are no longer allowed to use Super Search, due to an excessive use of this resource by robots.