http://www.perlmonks.org?node_id=157639


in reply to Spidering websites

Try wget.

In Section Seekers of Perl Wisdom