http://www.perlmonks.org?node_id=801367


in reply to Detect Broken links

If you google for "site:stonehenge.com link checker", you'll see that I have covered this subject a number of times, including a highly-configurable database-driven link checker which can be parallelized and resumed when interrupted.

-- Randal L. Schwartz, Perl hacker

The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in RFC 2119.